-- Logs begin at Thu 2022-05-12 19:24:06 UTC, end at Thu 2022-05-12 21:29:47 UTC. -- May 12 20:16:02.233242 dv-cinder-815659-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 12 20:16:02.240629 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 20:16:02 2022] *** May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: nodename: dv-cinder-815659-7-iscsi May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: machine: x86_64 May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: clock source: unix May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: pcre jit disabled May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: detected number of CPU cores: 4 May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: current working directory: / May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: detected binary path: /usr/bin/uwsgi-core May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: your processes number limit is 47680 May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: your memory page size is 4096 bytes May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: detected max file descriptor number: 2048 May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: lock engine: pthread robust mutexes May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: thunder lock: enabled May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 20:16:02.244826 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 20:16:02.293292 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: Python main interpreter initialized at 0x55611fed19c0 May 12 20:16:02.293292 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: python threads support enabled May 12 20:16:02.293292 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: your server socket listen backlog is limited to 100 connections May 12 20:16:02.293292 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: your mercy for graceful operations on workers is 90 seconds May 12 20:16:02.298883 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: mapped 403077 bytes (393 KB) for 2 cores May 12 20:16:02.298883 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: *** Operational MODE: preforking *** May 12 20:16:02.298883 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: *** uWSGI is running in multiple interpreter mode *** May 12 20:16:02.298883 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: spawned uWSGI master process (pid: 80188) May 12 20:16:02.298883 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: spawned uWSGI worker 1 (pid: 80202, cores: 1) May 12 20:16:02.298883 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: spawned uWSGI worker 2 (pid: 80203, cores: 1) May 12 20:16:02.298883 dv-cinder-815659-7-iscsi devstack@keystone.service[80188]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 20:16:02.294834 dv-cinder-815659-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 12 20:16:08.079513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:16:08.079513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: from cryptography.utils import int_from_bytes May 12 20:16:08.080839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:16:08.080839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: from cryptography.utils import int_from_bytes May 12 20:16:08.089121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:16:08.089121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: from cryptography.utils import int_from_bytes May 12 20:16:08.090532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:16:08.090532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: from cryptography.utils import int_from_bytes May 12 20:16:08.131146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 20:16:08.131321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 20:16:08.131445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] command line args: [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 20:16:08.131718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 20:16:08.131898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ================================================================================ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 20:16:08.132154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] admin_token = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.132401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config_dir = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.132591 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.132774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] config_source = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.132956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] debug = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.133262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.133797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.133890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.134117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.134568 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.134676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.134821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_config_append = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.135015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.135196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_dir = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.135374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.135602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.135852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.136103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.136353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.136555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.136708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.137076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.137332 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.137556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.137833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.138035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.138271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.138524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.138773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.138949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 20:16:08.139126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.139297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 20:16:08.139297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] command line args: [] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 20:16:08.139570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 20:16:08.139801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.139974 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ================================================================================ {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 20:16:08.140123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] publish_errors = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.140292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] admin_token = **** {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.140462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.140462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.140730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] config_dir = [] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.140873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.141025 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.141025 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] config_source = [] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.141252 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.141421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] debug = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.141546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.141708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.141853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] standard_threads = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.141968 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.142117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.142233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.142347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.142470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.142584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.142703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.142815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_journal = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.142934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] list_limit = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.143052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_json = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.143180 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] log_config_append = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.143294 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_stderr = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.143413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.143567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] use_syslog = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.143686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] log_dir = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.143811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.143925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] log_file = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.144036 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.144154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.144267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.144384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.144506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.144625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.144737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.144849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.144849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.145063 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.145193 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.145403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.145521 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.145635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.145755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.145879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.145992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.146130 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.146272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.146390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.146510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.146624 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.146742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.146855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.146972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.147085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.147209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.147322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.147440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.147554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.147554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.147773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.147894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.148020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] publish_errors = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.148133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.148246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.148366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.148479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.148479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.148688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.148800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.148912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.149031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.149144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.149262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] standard_threads = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.149391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.149513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.149626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.149748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.149861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.149973 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.150092 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.150204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] use_journal = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.150204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] use_json = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.150490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.150605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] use_stderr = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.150719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.150839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] use_syslog = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.150958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.151071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:16:08.151194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.151308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.151426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.151538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.151650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.151769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.151890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.152003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.152121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.152234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.152346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.152463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.152746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.152928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.153118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.153327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.153448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.153562 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.153687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.153800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.153921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.154041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.154154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.154267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.154391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.154505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.154624 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.154624 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.154849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.154972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.155093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.155210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.155330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.155443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.155556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.155677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.155781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.155876 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.155976 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.156079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.156173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.156275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.156400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.156505 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.156601 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.156697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.156816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.156942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.157057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.157171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.157171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.157430 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.157535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.157655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.157655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.157872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.157872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.158092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.158092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.158303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.158303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.158533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.158643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.158755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.158869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.158996 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.158996 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.159218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.159321 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.159440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.159440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.159658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.159784 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.159904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.160014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.160126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.160126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.160647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.160762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.160874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.160987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.161100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.161214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.161354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.161479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.161593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.161707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.161819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.161938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.162057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.162183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.162298 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.162410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.162523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.162636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.162756 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.162944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.163059 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.163173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.163285 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.163399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.163512 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.163636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.163750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.163877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.164025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.164142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.164262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.164387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.164387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.164611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.164725 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.164838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.164952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.165073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.165206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.165419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.165540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.165655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.165780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.165911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.166040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.166156 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.166269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.166389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.166504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.166626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.166741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.166867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.166981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.167095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.167209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.167322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.167436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.167560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.167675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.167789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.167789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.168001 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.168115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.168763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.168916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.169086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.169298 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.169469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.169469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.169705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.169827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.169942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.170055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.170169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.external = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.170290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.170405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.170519 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.170632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.170748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.170862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.170983 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.171104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.password = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.171225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.171340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] auth.token = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.171453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.171573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.171697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.171812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.171926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.172039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.172153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.172266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.172388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.172503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.172617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.172731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.172845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.172959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.173081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.173204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.173378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.173495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.173615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.173729 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.173853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.173969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.174082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.174223 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.174354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.174471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.174585 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.174699 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.174821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.174944 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.175059 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.175173 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.175288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.175401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.175524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.175648 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.175764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.175878 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.175993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.176107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.176229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.176229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.176450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.176450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.176665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.176794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.176983 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.177102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.177225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] auth.external = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.177358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.177474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.177588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.177714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.177837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.177952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.178067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.178181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] auth.password = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.178295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.178418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] auth.token = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.178533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.178647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.178761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.178884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.179004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.179129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.179245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.179359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.179473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.179587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.179701 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.179823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.179938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.180052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.180199 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.180315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] credential.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.180430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.180544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.180658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.180811 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.180928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.181042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.181157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.181309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.181427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.181542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.181656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.181770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.181896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.182013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.182127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.182242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.182356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.182470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.182593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.182708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.182823 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.182943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.183058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.183173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.183296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.183411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.183526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.183640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.183753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.183946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.184615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.184790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] federation.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.184993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.185160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.185302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.185421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.185551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.185671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.185787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.185908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.186024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.186139 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.186262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.186379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.186494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.186608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.186723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.186837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.186960 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.187076 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.187190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.187304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.187419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.187533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.187655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.187771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.187885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.188000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.188114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.188228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.188356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.188473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.188588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.188702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.188817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.188931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.189054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.189170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.189327 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.189445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.189561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.189675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.189801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.189918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.190031 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.190146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.190260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.190375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.190497 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.190614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.190728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.190848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.190963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.191077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.191200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.191315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.191436 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.191551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.191667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.191781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.191904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.192020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.192133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.192247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.192361 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.192481 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.192605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.192721 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.192836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.192958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.193075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.193189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.193333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.193451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.193572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.193688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.193817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.193998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.194117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.194232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.194347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.194461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.194576 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.194698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.194814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.194928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.195042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.195157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.195271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.195271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.195500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.195618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.195733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.195849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.195963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.196086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.196201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.196201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.196414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.196528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.196642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.196765 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.196881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.196996 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.197110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.197224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.197361 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.197488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.197605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.197719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.197833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.197948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.198062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.198184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.198299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.198413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.198527 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.198641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.198755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.198877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.198994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.199108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.199222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.199335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.199482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.199650 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.199839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.200031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.200157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.200272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.200387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.200576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.200694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.200810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.200924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.201039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.201155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.201333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.201463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.201578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.201693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.201807 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.201921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.202044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.202161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.202276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.202397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.202512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.202626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.202750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.202865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.202979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.203093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.203208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.203323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.203446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.203561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.203675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.203789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.203903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.204017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.204140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.204256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.204370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.204485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.204599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.204713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.204836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.204951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.205066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.205179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.205330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.205447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.205575 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.205694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.205809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.205923 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.206038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.206152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.206275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.206392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.206506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.206620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.206735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.206858 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.206973 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.207152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.207269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.207384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.207499 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.207623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.207739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.207853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.207974 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.208090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.208205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.208328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.208444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.208593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.208711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.208826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.208940 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] resource.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.209063 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.209178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.209312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.209428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.209554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.209701 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.209825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.209941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.210056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.210170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.210284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.210398 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.210525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.210641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.210755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.210869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.210983 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.211097 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.211220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.211336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] role.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.211450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.211565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] role.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.211565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.211780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.211903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.212046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.212046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.212261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.212376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.212490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.212614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.212730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.212844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.212957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.213071 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.213185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.213341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.213459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.213573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.213689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.213803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.213917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.214039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.214154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.214268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.214383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.214498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.214612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.214737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.214852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.214966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.215596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.215734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.215935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.216124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.216331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.216462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.216578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.216692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.216817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.216933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.216933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.217147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.217147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.217389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.217518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.217634 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.217757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.217883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.217998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.218112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.218227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.218341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.218464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.218579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.218693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.218813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.218930 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.219044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.219166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.219281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.219396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.219510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.219624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.219746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.219862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.219977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.220091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.220205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.220319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] token.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.220452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.220569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.220683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.220802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.220916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.221031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.221153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.221153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.221425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.221540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.221654 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.221768 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.221957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.222076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 20:16:08.222192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.222192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.222192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.222192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.222192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.222192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.222192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.222192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.222192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.223109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.223109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.223109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.connection = **** {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.223109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.223109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.223109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.223109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.223109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.223109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.224775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.225186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:16:08.225186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 20:16:08.249569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.249797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.250024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.252324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.252555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.252784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.258774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.261439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.288448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.288681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.290230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.290465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.342093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.342646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.394901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.395074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.395215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.395454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.461151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.461355 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.461468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.461552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.461628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.461740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.461824 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.461963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.462050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.462190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.462275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.462409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.485425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.485559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.485645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.485723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.485874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.485978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.486092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.486176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.486305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.486389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.486515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.486609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.486726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.486811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.499065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.499187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.514274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.514505 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.514596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.514731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.514817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.514955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.515038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.515173 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.515254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.515389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.515470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.515605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.515688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.515818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 20:16:08.532752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.532963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 20:16:08.533211 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.533323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.533448 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 20:16:08.533536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 20:16:08.533763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.533861 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.533975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 20:16:08.534059 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.534245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.534329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.534503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.534594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.534758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.535012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.545595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.545876 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.546138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.546240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.546419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.546504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.546688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.546970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.554544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.555134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.557857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.558139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.558422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.558517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.558726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.559336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.559536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.559731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.559922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.560007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.560200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.560283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.560461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.560543 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.560730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.560814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.561002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.561083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.561269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.561388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.561563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.561830 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.588617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.589032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.590315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.590593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.590818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.591101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.596115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.596384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.596483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.596662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.596746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.596942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.604055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.604251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.604336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.604533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.609643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.609910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.610084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.610197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.610280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.610477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.610560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.610744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.610836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.611017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.611101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.611287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.611370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.611554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.611637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.611823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.630973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.631248 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.631530 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.631806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.635772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.636379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.639474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.639770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.640240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.640534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.644754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.645648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.648351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.649224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.652105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.652416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.652859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.653040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.653138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.653450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.653551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.653732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.653824 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.654089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.654369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.654649 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.673312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.673688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.673964 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.674228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.674400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.674777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.675047 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.675313 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.682143 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.683238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.684413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.684698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.685538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.685828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.687792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.688073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.688363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.688646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.688878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.688963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.689154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.689457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.689741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.690029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.702514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.702792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.703077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.703372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.703654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.703836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.703922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.704115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.704200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.704399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.704689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.704965 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.705245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.705541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.722549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.723731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.725871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.727028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.729176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.730381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.731375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.732526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.733104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.733408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.733701 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.734192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.734470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.734767 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.741147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.742241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.742786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.743857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.746368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.746665 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.746964 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.747239 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.747581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.747870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.748149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.748422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.756470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.756766 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.757048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.757676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.757980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.758262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.766755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.766990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 20:16:08.767078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.767273 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.767372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.767557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.767643 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.767823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.767907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.768092 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.768184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.768369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.768455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.768647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.768730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.768917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.769002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.769183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.769266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.769473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.769567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.769747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.769829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.770014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.770096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.770270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.770441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.770521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 20:16:08.809634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55611fed19c0 pid: 80203 (default app) May 12 20:16:08.810172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55611fed19c0 pid: 80202 (default app) May 12 20:16:08.812960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38335c-5786-4e1c-b0a8-abb7d2f1cc46 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:08.813259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38335c-5786-4e1c-b0a8-abb7d2f1cc46 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:08.813572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38335c-5786-4e1c-b0a8-abb7d2f1cc46 None None] PATH_INFO: `/v3` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:08.817749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Thu May 12 20:16:08 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:17.625477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21f412-8ce1-4702-96f8-c21f671a80f2 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:17.626055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21f412-8ce1-4702-96f8-c21f671a80f2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:17.626055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21f412-8ce1-4702-96f8-c21f671a80f2 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:17.630288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:16:17.635422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23ef5-3c9b-4918-ac67-81e37329e2b9 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:17.635859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23ef5-3c9b-4918-ac67-81e37329e2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:17.635986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23ef5-3c9b-4918-ac67-81e37329e2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:17.667221 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG oslo_db.sqlalchemy.engines [None req-e7a23ef5-3c9b-4918-ac67-81e37329e2b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:16:17.850411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG passlib.handlers.bcrypt [None req-e7a23ef5-3c9b-4918-ac67-81e37329e2b9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80203) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 20:16:17.850827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG passlib.handlers.bcrypt [None req-e7a23ef5-3c9b-4918-ac67-81e37329e2b9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80203) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 20:16:17.907166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-e7a23ef5-3c9b-4918-ac67-81e37329e2b9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:17.908716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e7a23ef5-3c9b-4918-ac67-81e37329e2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:18.032744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 20:16:18.190615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21f412-8ce1-4702-96f8-c21f671a80f2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:18.225010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG oslo_db.sqlalchemy.engines [None req-2e21f412-8ce1-4702-96f8-c21f671a80f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80202) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:16:18.353413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21f412-8ce1-4702-96f8-c21f671a80f2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:18.358211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4b4d0-4bdd-4248-9612-4c0178eb83ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:18.358870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b4d0-4bdd-4248-9612-4c0178eb83ab admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:18.359155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b4d0-4bdd-4248-9612-4c0178eb83ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:18.359429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b4d0-4bdd-4248-9612-4c0178eb83ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:18.367486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4b4d0-4bdd-4248-9612-4c0178eb83ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:18.421606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: WARNING keystone.common.rbac_enforcer.enforcer [None req-86e4b4d0-4bdd-4248-9612-4c0178eb83ab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 20:16:18.421945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4b4d0-4bdd-4248-9612-4c0178eb83ab admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:18.431611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Thu May 12 20:16:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 20:16:18.437934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23ef5-3c9b-4918-ac67-81e37329e2b9 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:18.452638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23ef5-3c9b-4918-ac67-81e37329e2b9 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:18.457157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba76e5e-88a8-4339-9753-892be8c791cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:18.458295 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76e5e-88a8-4339-9753-892be8c791cd admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:18.458583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76e5e-88a8-4339-9753-892be8c791cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:18.458876 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76e5e-88a8-4339-9753-892be8c791cd admin admin] PATH_INFO: `/v3/projects/023813922bcf4863880d01ff0f27548c` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:18.460399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba76e5e-88a8-4339-9753-892be8c791cd admin admin] RBAC: Authorizing `identity:get_project(project_id=023813922bcf4863880d01ff0f27548c)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:18.510567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ba76e5e-88a8-4339-9753-892be8c791cd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 20:16:18.510912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba76e5e-88a8-4339-9753-892be8c791cd admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:18.516256 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Thu May 12 20:16:18 2022] GET /identity/v3/projects/023813922bcf4863880d01ff0f27548c => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:20.707807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd64d0-a04f-46d8-9fba-3a14824fa331 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:20.708353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd64d0-a04f-46d8-9fba-3a14824fa331 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:20.708353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd64d0-a04f-46d8-9fba-3a14824fa331 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:20.712474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:20.718122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12feba-8276-4522-8d88-b849b7993372 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:20.718596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12feba-8276-4522-8d88-b849b7993372 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:20.718689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12feba-8276-4522-8d88-b849b7993372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:20.739204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-bf12feba-8276-4522-8d88-b849b7993372 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:20.740737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bf12feba-8276-4522-8d88-b849b7993372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:20.749670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 20:16:20.771474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd64d0-a04f-46d8-9fba-3a14824fa331 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:20.783431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd64d0-a04f-46d8-9fba-3a14824fa331 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:20.787626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f8a67-495b-4336-b5bd-0106a46654f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:20.788259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f8a67-495b-4336-b5bd-0106a46654f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:20.788547 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f8a67-495b-4336-b5bd-0106a46654f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:20.788830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f8a67-495b-4336-b5bd-0106a46654f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:20.797070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f8a67-495b-4336-b5bd-0106a46654f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:20.798848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f8a67-495b-4336-b5bd-0106a46654f6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:20.807407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Thu May 12 20:16:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:16:20.813335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12feba-8276-4522-8d88-b849b7993372 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:20.822144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12feba-8276-4522-8d88-b849b7993372 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:20.826636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69151cb-ff8c-4655-9e45-3579232a9171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:20.827499 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69151cb-ff8c-4655-9e45-3579232a9171 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:20.827788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69151cb-ff8c-4655-9e45-3579232a9171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:20.828069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69151cb-ff8c-4655-9e45-3579232a9171 admin admin] PATH_INFO: `/v3/users/4a85c2f6540a47cfa927556bdcddaf95` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:20.829501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69151cb-ff8c-4655-9e45-3579232a9171 admin admin] RBAC: Authorizing `identity:get_user(user_id=4a85c2f6540a47cfa927556bdcddaf95)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:20.831318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69151cb-ff8c-4655-9e45-3579232a9171 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:20.832878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Thu May 12 20:16:20 2022] GET /identity/v3/users/4a85c2f6540a47cfa927556bdcddaf95 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:23.112557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7853aab-b6a1-4c96-8d1d-8d55ef44790d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:23.113061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7853aab-b6a1-4c96-8d1d-8d55ef44790d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:23.113061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7853aab-b6a1-4c96-8d1d-8d55ef44790d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:23.114427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:23.119937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dab0a-748d-4b10-83d3-cf82cb716232 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:23.120373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dab0a-748d-4b10-83d3-cf82cb716232 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:23.120501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dab0a-748d-4b10-83d3-cf82cb716232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:23.164386 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62a48-59fa-44b8-9e5c-b7a80b4be346 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:23.164680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62a48-59fa-44b8-9e5c-b7a80b4be346 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:23.164965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe62a48-59fa-44b8-9e5c-b7a80b4be346 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:23.166374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:16:23.172779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bd1fd-4a19-4b31-b9a2-b82e24932611 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:23.173073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bd1fd-4a19-4b31-b9a2-b82e24932611 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:23.173391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bd1fd-4a19-4b31-b9a2-b82e24932611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:23.215972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG passlib.handlers.bcrypt [None req-4a3bd1fd-4a19-4b31-b9a2-b82e24932611 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80202) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 20:16:23.216395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG passlib.handlers.bcrypt [None req-4a3bd1fd-4a19-4b31-b9a2-b82e24932611 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80202) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 20:16:23.248866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-568dab0a-748d-4b10-83d3-cf82cb716232 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:23.251080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-568dab0a-748d-4b10-83d3-cf82cb716232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:23.264567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4a3bd1fd-4a19-4b31-b9a2-b82e24932611 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:23.266347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4a3bd1fd-4a19-4b31-b9a2-b82e24932611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:23.335574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:23.359739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dab0a-748d-4b10-83d3-cf82cb716232 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:23.367926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:23.389538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bd1fd-4a19-4b31-b9a2-b82e24932611 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:23.455388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dab0a-748d-4b10-83d3-cf82cb716232 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:23.486694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bd1fd-4a19-4b31-b9a2-b82e24932611 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:23.488386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a551-6537-4552-868e-e19bcfc79a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:23.489183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a551-6537-4552-868e-e19bcfc79a33 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:23.489501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a551-6537-4552-868e-e19bcfc79a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:23.489782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a551-6537-4552-868e-e19bcfc79a33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:23.500907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35a551-6537-4552-868e-e19bcfc79a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-1b35a551-6537-4552-868e-e19bcfc79a33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:23.512326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:23.513185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:23.514483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:16:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:16:23.518894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8d527-ab95-489e-a7c0-faa2adbee12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:23.519296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a551-6537-4552-868e-e19bcfc79a33 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:23.519801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8d527-ab95-489e-a7c0-faa2adbee12a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:23.520094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8d527-ab95-489e-a7c0-faa2adbee12a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:23.520375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8d527-ab95-489e-a7c0-faa2adbee12a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:23.587447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8d527-ab95-489e-a7c0-faa2adbee12a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:23.588970 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8d527-ab95-489e-a7c0-faa2adbee12a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:23.620040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a551-6537-4552-868e-e19bcfc79a33 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:23.652917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4590f04-4f35-475a-8045-dcad19c6c96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:23.653614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4590f04-4f35-475a-8045-dcad19c6c96d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:23.653905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4590f04-4f35-475a-8045-dcad19c6c96d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:23.654185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4590f04-4f35-475a-8045-dcad19c6c96d None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:23.654941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4590f04-4f35-475a-8045-dcad19c6c96d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:23.655252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4590f04-4f35-475a-8045-dcad19c6c96d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:23.656650 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4590f04-4f35-475a-8045-dcad19c6c96d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:23.668426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:23.673903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4590f04-4f35-475a-8045-dcad19c6c96d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:23.684433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 20:16:23.689770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8d527-ab95-489e-a7c0-faa2adbee12a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:23.776519 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4590f04-4f35-475a-8045-dcad19c6c96d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:23.810956 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60061dc-822e-451f-be21-bbc025f1a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:23.811837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60061dc-822e-451f-be21-bbc025f1a801 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:23.812123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60061dc-822e-451f-be21-bbc025f1a801 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:23.812402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60061dc-822e-451f-be21-bbc025f1a801 None admin] PATH_INFO: `/v3/users/4a85c2f6540a47cfa927556bdcddaf95` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:23.813658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60061dc-822e-451f-be21-bbc025f1a801 None admin] RBAC: Authorizing `identity:get_user(user_id=4a85c2f6540a47cfa927556bdcddaf95)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:23.815126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60061dc-822e-451f-be21-bbc025f1a801 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:23.816746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:23 2022] GET /identity/v3/users/4a85c2f6540a47cfa927556bdcddaf95 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:23.822053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60061dc-822e-451f-be21-bbc025f1a801 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:23.893477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8d527-ab95-489e-a7c0-faa2adbee12a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:23.917283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60061dc-822e-451f-be21-bbc025f1a801 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:23.926239 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec939e08-500d-420b-bea3-cf060f004956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:23.927084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec939e08-500d-420b-bea3-cf060f004956 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:23.927370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec939e08-500d-420b-bea3-cf060f004956 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:23.927654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec939e08-500d-420b-bea3-cf060f004956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:23.946714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec939e08-500d-420b-bea3-cf060f004956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:23.948184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec939e08-500d-420b-bea3-cf060f004956 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:23.951348 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678f511-ec74-4658-ae1b-b0fb0e3e1ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:23.952212 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678f511-ec74-4658-ae1b-b0fb0e3e1ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:23.952505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678f511-ec74-4658-ae1b-b0fb0e3e1ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:23.952786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678f511-ec74-4658-ae1b-b0fb0e3e1ac4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:23.953980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678f511-ec74-4658-ae1b-b0fb0e3e1ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:23.955427 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678f511-ec74-4658-ae1b-b0fb0e3e1ac4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:23.957018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 10/18] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:23.962574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678f511-ec74-4658-ae1b-b0fb0e3e1ac4 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ec939e08-500d-420b-bea3-cf060f004956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:16:23.968530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:23.969580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:23.970364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:16:23.970364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:16:23.970364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:16:23.970364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:16:23.970364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 9/19] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:16:23.975377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec939e08-500d-420b-bea3-cf060f004956 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:24.056738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678f511-ec74-4658-ae1b-b0fb0e3e1ac4 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:24.070348 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec939e08-500d-420b-bea3-cf060f004956 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:24.088341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492552a-7a32-418d-adf1-81b65e6fecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:24.089004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492552a-7a32-418d-adf1-81b65e6fecfa None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:24.089850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492552a-7a32-418d-adf1-81b65e6fecfa None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:24.090134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492552a-7a32-418d-adf1-81b65e6fecfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:24.090967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492552a-7a32-418d-adf1-81b65e6fecfa None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.domain.id=default, user.id=4a85c2f6540a47cfa927556bdcddaf95) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:24.091281 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492552a-7a32-418d-adf1-81b65e6fecfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:24.092716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492552a-7a32-418d-adf1-81b65e6fecfa None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:24.099517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 11/20] 10.222.0.59 () {56 vars in 1322 bytes} [Thu May 12 20:16:23 2022] GET /identity/v3/role_assignments?user.id=4a85c2f6540a47cfa927556bdcddaf95&scope.domain.id=default&role.id=4ae0665802b946be870ab06274297a1d => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:24.103138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f188881-53d2-44c4-840a-81a13b9d8880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:24.103821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188881-53d2-44c4-840a-81a13b9d8880 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:24.104114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188881-53d2-44c4-840a-81a13b9d8880 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:24.104398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188881-53d2-44c4-840a-81a13b9d8880 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:24.105239 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f188881-53d2-44c4-840a-81a13b9d8880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:24.105675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f188881-53d2-44c4-840a-81a13b9d8880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:24.107128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f188881-53d2-44c4-840a-81a13b9d8880 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:24.127618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 10/21] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:26.619665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf56db3-a970-414d-8d24-71738750e574 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:26.621419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf56db3-a970-414d-8d24-71738750e574 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:26.621947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf56db3-a970-414d-8d24-71738750e574 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:26.623852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 12/22] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:26.629046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff33899-568a-4288-ae2f-82d3b5bd0125 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:26.629914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff33899-568a-4288-ae2f-82d3b5bd0125 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:26.630410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff33899-568a-4288-ae2f-82d3b5bd0125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:26.648077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4ff33899-568a-4288-ae2f-82d3b5bd0125 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:26.649266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4ff33899-568a-4288-ae2f-82d3b5bd0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:26.738254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:26.779737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf56db3-a970-414d-8d24-71738750e574 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:26.872186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c688-0b45-4d5d-b092-6c65cde23cdd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:26.872810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c688-0b45-4d5d-b092-6c65cde23cdd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:26.873633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587c688-0b45-4d5d-b092-6c65cde23cdd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:26.877553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 12/24] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:16:26.883146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcc737-6de3-448f-83d9-bdf2f474a015 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:26.883778 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcc737-6de3-448f-83d9-bdf2f474a015 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:26.884267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcc737-6de3-448f-83d9-bdf2f474a015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:26.906761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-08dcc737-6de3-448f-83d9-bdf2f474a015 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:26.908273 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-08dcc737-6de3-448f-83d9-bdf2f474a015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:26.939615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf56db3-a970-414d-8d24-71738750e574 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:26.991010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 13/25] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:27.014425 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcc737-6de3-448f-83d9-bdf2f474a015 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:27.038026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140d4c3-386a-47e8-83b7-9765ea672e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:27.038848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140d4c3-386a-47e8-83b7-9765ea672e6a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.039138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140d4c3-386a-47e8-83b7-9765ea672e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.039428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140d4c3-386a-47e8-83b7-9765ea672e6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.070208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140d4c3-386a-47e8-83b7-9765ea672e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-3140d4c3-386a-47e8-83b7-9765ea672e6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:27.078177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:27.079203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:27.080141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:27.091346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 13/26] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:27.096555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140d4c3-386a-47e8-83b7-9765ea672e6a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:27.126345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcc737-6de3-448f-83d9-bdf2f474a015 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:27.163711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86863e81-197c-498a-9e01-8aa74d4998e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:27.164874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86863e81-197c-498a-9e01-8aa74d4998e2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.165380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86863e81-197c-498a-9e01-8aa74d4998e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.165876 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86863e81-197c-498a-9e01-8aa74d4998e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.179035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86863e81-197c-498a-9e01-8aa74d4998e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:27.180900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86863e81-197c-498a-9e01-8aa74d4998e2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-86863e81-197c-498a-9e01-8aa74d4998e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:16:27.204027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:27.204954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:27.205775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:16:27.205775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:16:27.205775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:16:27.205775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:16:27.211625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 14/27] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:16:27.214550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86863e81-197c-498a-9e01-8aa74d4998e2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:27.322457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140d4c3-386a-47e8-83b7-9765ea672e6a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:27.380197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12bb02-c12b-4099-9fcf-1f7edc4ef96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:27.382554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12bb02-c12b-4099-9fcf-1f7edc4ef96f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.383061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12bb02-c12b-4099-9fcf-1f7edc4ef96f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.384441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12bb02-c12b-4099-9fcf-1f7edc4ef96f None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.385435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12bb02-c12b-4099-9fcf-1f7edc4ef96f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:27.387495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12bb02-c12b-4099-9fcf-1f7edc4ef96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:27.389331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12bb02-c12b-4099-9fcf-1f7edc4ef96f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:27.395629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86863e81-197c-498a-9e01-8aa74d4998e2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:27.410709 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 14/28] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:27.416395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12bb02-c12b-4099-9fcf-1f7edc4ef96f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:27.447158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34440-7aba-4859-ad12-20ed987c2e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:27.448200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34440-7aba-4859-ad12-20ed987c2e4a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.449217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34440-7aba-4859-ad12-20ed987c2e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.449741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34440-7aba-4859-ad12-20ed987c2e4a None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.450668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34440-7aba-4859-ad12-20ed987c2e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:27.451270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34440-7aba-4859-ad12-20ed987c2e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:27.452871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34440-7aba-4859-ad12-20ed987c2e4a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:27.466339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 15/29] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:27.472231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34440-7aba-4859-ad12-20ed987c2e4a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:27.574331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34440-7aba-4859-ad12-20ed987c2e4a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:27.604356 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12bb02-c12b-4099-9fcf-1f7edc4ef96f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:27.616858 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b51fc4-661a-4eba-8fcc-2966cda6f377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:27.617881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b51fc4-661a-4eba-8fcc-2966cda6f377 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.618266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b51fc4-661a-4eba-8fcc-2966cda6f377 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.618641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b51fc4-661a-4eba-8fcc-2966cda6f377 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.620641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b51fc4-661a-4eba-8fcc-2966cda6f377 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:27.622478 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b51fc4-661a-4eba-8fcc-2966cda6f377 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:27.639758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7300acf-04e4-44f3-8094-d92d2178fdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:27.641254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300acf-04e4-44f3-8094-d92d2178fdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.641702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300acf-04e4-44f3-8094-d92d2178fdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.642140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7300acf-04e4-44f3-8094-d92d2178fdd4 None admin] PATH_INFO: `/v3/users/4a85c2f6540a47cfa927556bdcddaf95` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.643505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7300acf-04e4-44f3-8094-d92d2178fdd4 None admin] RBAC: Authorizing `identity:get_user(user_id=4a85c2f6540a47cfa927556bdcddaf95)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:27.645091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7300acf-04e4-44f3-8094-d92d2178fdd4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:27.648100 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 15/30] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:27 2022] GET /identity/v3/users/4a85c2f6540a47cfa927556bdcddaf95 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:27.649962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42dab1-10ff-4d68-9676-3a9ff6154c99 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.650397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42dab1-10ff-4d68-9676-3a9ff6154c99 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.650803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42dab1-10ff-4d68-9676-3a9ff6154c99 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.653056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 16/31] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:27.654383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc1dc-878a-4cd6-b3f0-c198e8ee867d None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.660945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc1dc-878a-4cd6-b3f0-c198e8ee867d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.660945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc1dc-878a-4cd6-b3f0-c198e8ee867d None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.660945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 17/32] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:27.660945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fc1dc-878a-4cd6-b3f0-c198e8ee867d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:27.761043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fc1dc-878a-4cd6-b3f0-c198e8ee867d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:27.796658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d0ec9-df7f-4414-a21e-75b592a8201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:27.797522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0ec9-df7f-4414-a21e-75b592a8201d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.797815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0ec9-df7f-4414-a21e-75b592a8201d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.798095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0ec9-df7f-4414-a21e-75b592a8201d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.799297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d0ec9-df7f-4414-a21e-75b592a8201d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:27.800810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d0ec9-df7f-4414-a21e-75b592a8201d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:27.802886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 18/33] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:27.804124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1f48-c07f-4db7-b16e-73785d5c019f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.804418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1f48-c07f-4db7-b16e-73785d5c019f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.804702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1f48-c07f-4db7-b16e-73785d5c019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.822179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-c86b1f48-c07f-4db7-b16e-73785d5c019f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:27.823366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c86b1f48-c07f-4db7-b16e-73785d5c019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:27.888296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 16/34] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:16:27 2022] POST /identity/v3/projects => generated 301 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:16:27.890632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1ce81-189e-4ddf-93ed-13ef41cb8006 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:27.891129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1ce81-189e-4ddf-93ed-13ef41cb8006 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:27.891630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1ce81-189e-4ddf-93ed-13ef41cb8006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:27.894605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 19/35] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:27.900684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b1f48-c07f-4db7-b16e-73785d5c019f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:27.911878 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2bc1ce81-189e-4ddf-93ed-13ef41cb8006 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:27.913842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2bc1ce81-189e-4ddf-93ed-13ef41cb8006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:27.991049 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 17/36] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:27.992262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1ce81-189e-4ddf-93ed-13ef41cb8006 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:28.056957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b1f48-c07f-4db7-b16e-73785d5c019f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:28.108312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761047da-ea56-4549-8f66-0ce775358f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:28.109581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761047da-ea56-4549-8f66-0ce775358f73 None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:28.109878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761047da-ea56-4549-8f66-0ce775358f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:28.110172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761047da-ea56-4549-8f66-0ce775358f73 None admin] PATH_INFO: `/v3/domains/default/users/4a85c2f6540a47cfa927556bdcddaf95/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:28.113075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761047da-ea56-4549-8f66-0ce775358f73 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4a85c2f6540a47cfa927556bdcddaf95, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:28.114617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761047da-ea56-4549-8f66-0ce775358f73 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:28.115346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1ce81-189e-4ddf-93ed-13ef41cb8006 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:28.159287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea1aae-e486-4d59-8331-dd0efdfae5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:28.159911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea1aae-e486-4d59-8331-dd0efdfae5a6 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:28.160203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea1aae-e486-4d59-8331-dd0efdfae5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:28.160554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea1aae-e486-4d59-8331-dd0efdfae5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:28.161893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea1aae-e486-4d59-8331-dd0efdfae5a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:28.163168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea1aae-e486-4d59-8331-dd0efdfae5a6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:28.254953 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1131 bytes} [Thu May 12 20:16:27 2022] POST /identity/v3/roles => generated 219 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:16:28.256372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea1aae-e486-4d59-8331-dd0efdfae5a6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:28.331325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 20/38] 10.222.0.59 () {58 vars in 1361 bytes} [Thu May 12 20:16:27 2022] PUT /identity/v3/domains/default/users/4a85c2f6540a47cfa927556bdcddaf95/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:16:28.333378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d2fc-c9ec-41fc-8fff-10950521c71e None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:28.333684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d2fc-c9ec-41fc-8fff-10950521c71e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:28.333976 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d2fc-c9ec-41fc-8fff-10950521c71e None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:28.338762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 21/39] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:28.345291 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d711f4-ea77-4738-9dd6-95772205c125 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:28.345640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d711f4-ea77-4738-9dd6-95772205c125 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:28.345886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d711f4-ea77-4738-9dd6-95772205c125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:28.365947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-b6d711f4-ea77-4738-9dd6-95772205c125 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:28.367568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b6d711f4-ea77-4738-9dd6-95772205c125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:28.384880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea1aae-e486-4d59-8331-dd0efdfae5a6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:28.427451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841b9eb-7d43-495f-8261-99f38ae721c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:28.428574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841b9eb-7d43-495f-8261-99f38ae721c3 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:28.429057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841b9eb-7d43-495f-8261-99f38ae721c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:28.429632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841b9eb-7d43-495f-8261-99f38ae721c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:28.430605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841b9eb-7d43-495f-8261-99f38ae721c3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:28.432258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841b9eb-7d43-495f-8261-99f38ae721c3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:28.448348 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 22/40] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:28.474483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d711f4-ea77-4738-9dd6-95772205c125 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:28.509314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 19/41] 10.222.0.59 () {60 vars in 1131 bytes} [Thu May 12 20:16:28 2022] POST /identity/v3/roles => generated 225 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:16:28.595395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24a9d6-b0f6-43b0-b69f-c8885e361ecd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:28.595712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24a9d6-b0f6-43b0-b69f-c8885e361ecd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:28.595887 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d711f4-ea77-4738-9dd6-95772205c125 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:28.596008 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24a9d6-b0f6-43b0-b69f-c8885e361ecd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:28.597614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 20/42] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:16:28.603623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074fbd2-b935-4965-8ad4-8ca317353075 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:28.603907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074fbd2-b935-4965-8ad4-8ca317353075 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:28.604196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074fbd2-b935-4965-8ad4-8ca317353075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:28.631722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0074fbd2-b935-4965-8ad4-8ca317353075 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:28.632953 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0074fbd2-b935-4965-8ad4-8ca317353075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:28.642078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c4fcb-909d-45f8-b3f6-00855d368f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:28.642925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c4fcb-909d-45f8-b3f6-00855d368f53 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:28.643224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c4fcb-909d-45f8-b3f6-00855d368f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:28.643845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c4fcb-909d-45f8-b3f6-00855d368f53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:28.644808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c4fcb-909d-45f8-b3f6-00855d368f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:28.646477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c4fcb-909d-45f8-b3f6-00855d368f53 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:28.648505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 23/43] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:28.656485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c4fcb-909d-45f8-b3f6-00855d368f53 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:28.708870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 21/44] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:28.731503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074fbd2-b935-4965-8ad4-8ca317353075 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:28.783830 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c4fcb-909d-45f8-b3f6-00855d368f53 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:28.829934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f9c47-9fe8-43b9-a3ee-5cfa39e453e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:28.830617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f9c47-9fe8-43b9-a3ee-5cfa39e453e4 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:28.830912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f9c47-9fe8-43b9-a3ee-5cfa39e453e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:28.831199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f9c47-9fe8-43b9-a3ee-5cfa39e453e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:28.831920 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f9c47-9fe8-43b9-a3ee-5cfa39e453e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:28.833399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f9c47-9fe8-43b9-a3ee-5cfa39e453e4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:28.852972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074fbd2-b935-4965-8ad4-8ca317353075 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:28.887279 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce850e8-5564-445c-91fd-17d2fd0c1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:28.887949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce850e8-5564-445c-91fd-17d2fd0c1b60 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:28.888236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce850e8-5564-445c-91fd-17d2fd0c1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:28.888518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce850e8-5564-445c-91fd-17d2fd0c1b60 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:28.889267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce850e8-5564-445c-91fd-17d2fd0c1b60 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:28.890730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce850e8-5564-445c-91fd-17d2fd0c1b60 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:28.924373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 24/45] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:16:28 2022] POST /identity/v3/projects => generated 312 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:16:29.031981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 22/46] 10.222.0.59 () {60 vars in 1131 bytes} [Thu May 12 20:16:28 2022] POST /identity/v3/roles => generated 223 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:16:30.788847 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad478-298f-4753-8f1f-03891ecf9778 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:30.789401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad478-298f-4753-8f1f-03891ecf9778 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:30.789484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad478-298f-4753-8f1f-03891ecf9778 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:30.790835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 25/47] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:30.796824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690786e1-136b-444e-b911-3416f4f7ed7e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:30.797257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690786e1-136b-444e-b911-3416f4f7ed7e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:30.797480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690786e1-136b-444e-b911-3416f4f7ed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:30.813821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-690786e1-136b-444e-b911-3416f4f7ed7e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:30.815001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-690786e1-136b-444e-b911-3416f4f7ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:30.878992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 23/48] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:30.902471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ad478-298f-4753-8f1f-03891ecf9778 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:31.005056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ad478-298f-4753-8f1f-03891ecf9778 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:31.039053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11325e-89ed-4a0a-862d-dc4cefe1e8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:31.039769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11325e-89ed-4a0a-862d-dc4cefe1e8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:31.040055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11325e-89ed-4a0a-862d-dc4cefe1e8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:31.040334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11325e-89ed-4a0a-862d-dc4cefe1e8b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:31.050800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11325e-89ed-4a0a-862d-dc4cefe1e8b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-3a11325e-89ed-4a0a-862d-dc4cefe1e8b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:31.058508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:31.059380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:31.060134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 26/49] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:16:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:31.065598 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690786e1-136b-444e-b911-3416f4f7ed7e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:31.153919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890b59-ae6c-440c-a11e-d7017cc42a70 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:31.154336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890b59-ae6c-440c-a11e-d7017cc42a70 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:31.154684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890b59-ae6c-440c-a11e-d7017cc42a70 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:31.156276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 27/50] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:16:31.160629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690786e1-136b-444e-b911-3416f4f7ed7e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:31.160954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a674438-7389-438e-a153-4dd8117e750e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:31.161246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a674438-7389-438e-a153-4dd8117e750e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:31.161558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a674438-7389-438e-a153-4dd8117e750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:31.177828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-0a674438-7389-438e-a153-4dd8117e750e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:31.179004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0a674438-7389-438e-a153-4dd8117e750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:31.193429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b9feb-e69f-48db-a6d2-14890b051d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:31.194102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b9feb-e69f-48db-a6d2-14890b051d9a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:31.194391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b9feb-e69f-48db-a6d2-14890b051d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:31.194674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b9feb-e69f-48db-a6d2-14890b051d9a None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:31.195427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b9feb-e69f-48db-a6d2-14890b051d9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:31.195735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b9feb-e69f-48db-a6d2-14890b051d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:31.197111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b9feb-e69f-48db-a6d2-14890b051d9a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:31.212271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 24/51] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:31.215675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b9feb-e69f-48db-a6d2-14890b051d9a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:31.246347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 28/52] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:31.269834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a674438-7389-438e-a153-4dd8117e750e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:31.309142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b9feb-e69f-48db-a6d2-14890b051d9a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:31.341882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb41f7-f66c-4acb-9214-38e19d1ec016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:31.342759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb41f7-f66c-4acb-9214-38e19d1ec016 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:31.343041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb41f7-f66c-4acb-9214-38e19d1ec016 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:31.343313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb41f7-f66c-4acb-9214-38e19d1ec016 None admin] PATH_INFO: `/v3/users/4a85c2f6540a47cfa927556bdcddaf95` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:31.344742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb41f7-f66c-4acb-9214-38e19d1ec016 None admin] RBAC: Authorizing `identity:get_user(user_id=4a85c2f6540a47cfa927556bdcddaf95)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:31.346222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb41f7-f66c-4acb-9214-38e19d1ec016 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:31.347822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 25/53] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:31 2022] GET /identity/v3/users/4a85c2f6540a47cfa927556bdcddaf95 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:31.353029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb41f7-f66c-4acb-9214-38e19d1ec016 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:31.363967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a674438-7389-438e-a153-4dd8117e750e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:31.397233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef6eb1-d7fe-4fd4-860b-c00f08a4560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:31.398047 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef6eb1-d7fe-4fd4-860b-c00f08a4560d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:31.398334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef6eb1-d7fe-4fd4-860b-c00f08a4560d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:31.398608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef6eb1-d7fe-4fd4-860b-c00f08a4560d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:31.399782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef6eb1-d7fe-4fd4-860b-c00f08a4560d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:31.401222 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef6eb1-d7fe-4fd4-860b-c00f08a4560d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:31.403925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 29/54] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:31.409225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef6eb1-d7fe-4fd4-860b-c00f08a4560d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:31.447290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb41f7-f66c-4acb-9214-38e19d1ec016 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:31.479031 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42bb88-4bab-4c02-907b-eadadcc30652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:31.480420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bb88-4bab-4c02-907b-eadadcc30652 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:31.480710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bb88-4bab-4c02-907b-eadadcc30652 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:31.480993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bb88-4bab-4c02-907b-eadadcc30652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:31.482224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42bb88-4bab-4c02-907b-eadadcc30652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:31.483679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42bb88-4bab-4c02-907b-eadadcc30652 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:31.485509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 26/55] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:31.490995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42bb88-4bab-4c02-907b-eadadcc30652 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:31.504535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef6eb1-d7fe-4fd4-860b-c00f08a4560d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:31.537084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe59ef-cd20-453a-bbec-a7ee8ac2c125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:31.537782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe59ef-cd20-453a-bbec-a7ee8ac2c125 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:31.538077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe59ef-cd20-453a-bbec-a7ee8ac2c125 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:31.538374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe59ef-cd20-453a-bbec-a7ee8ac2c125 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:31.539076 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe59ef-cd20-453a-bbec-a7ee8ac2c125 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:31.540516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe59ef-cd20-453a-bbec-a7ee8ac2c125 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:31.585562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42bb88-4bab-4c02-907b-eadadcc30652 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:31.618247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b394c8-3ae7-49ae-8dfb-cb4696c3b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:31.618906 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b394c8-3ae7-49ae-8dfb-cb4696c3b931 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:31.619196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b394c8-3ae7-49ae-8dfb-cb4696c3b931 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:31.619742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b394c8-3ae7-49ae-8dfb-cb4696c3b931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:31.620936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b394c8-3ae7-49ae-8dfb-cb4696c3b931 None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.domain.id=default, user.id=4a85c2f6540a47cfa927556bdcddaf95) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:31.621254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b394c8-3ae7-49ae-8dfb-cb4696c3b931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:31.622710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b394c8-3ae7-49ae-8dfb-cb4696c3b931 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:31.631390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 27/56] 10.222.0.59 () {56 vars in 1322 bytes} [Thu May 12 20:16:31 2022] GET /identity/v3/role_assignments?user.id=4a85c2f6540a47cfa927556bdcddaf95&scope.domain.id=default&role.id=4ae0665802b946be870ab06274297a1d => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:31.677749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 30/57] 10.222.0.59 () {60 vars in 1140 bytes} [Thu May 12 20:16:31 2022] POST /identity/v3/projects => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:16:33.910912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6826d1-6bc7-4f75-aba0-73f92df15070 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:33.911423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6826d1-6bc7-4f75-aba0-73f92df15070 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:33.911511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6826d1-6bc7-4f75-aba0-73f92df15070 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:33.912829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 28/58] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:33.918167 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9442d7-e05d-45fd-b6fc-2c7945cfc8f1 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:33.918571 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9442d7-e05d-45fd-b6fc-2c7945cfc8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:33.918745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9442d7-e05d-45fd-b6fc-2c7945cfc8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:33.935412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-9a9442d7-e05d-45fd-b6fc-2c7945cfc8f1 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:33.936616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9a9442d7-e05d-45fd-b6fc-2c7945cfc8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:34.000145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 31/59] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:34.025061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6826d1-6bc7-4f75-aba0-73f92df15070 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:34.122326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6826d1-6bc7-4f75-aba0-73f92df15070 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:34.153540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cccd3c-5161-4e80-bea7-531d83e43594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:34.154329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cccd3c-5161-4e80-bea7-531d83e43594 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:34.154618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cccd3c-5161-4e80-bea7-531d83e43594 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:34.154897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cccd3c-5161-4e80-bea7-531d83e43594 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:34.156066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cccd3c-5161-4e80-bea7-531d83e43594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:34.157542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cccd3c-5161-4e80-bea7-531d83e43594 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:34.159132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 29/60] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:34.164569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9442d7-e05d-45fd-b6fc-2c7945cfc8f1 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:34.260005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9442d7-e05d-45fd-b6fc-2c7945cfc8f1 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:34.293504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6f158-1788-489c-9ba0-138af9095071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:34.294186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6f158-1788-489c-9ba0-138af9095071 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:34.294472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6f158-1788-489c-9ba0-138af9095071 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:34.294747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6f158-1788-489c-9ba0-138af9095071 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:34.295463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6f158-1788-489c-9ba0-138af9095071 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:34.298640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6f158-1788-489c-9ba0-138af9095071 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:34.413059 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 32/61] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:16:34 2022] POST /identity/v3/users => generated 275 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:16:38.038580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0563e64-2369-4724-b849-f4554d525a2b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.039088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0563e64-2369-4724-b849-f4554d525a2b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.039161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0563e64-2369-4724-b849-f4554d525a2b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.040755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 30/62] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:38.046918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4d14e-eed9-4356-9d06-4426325f4a2a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.047412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4d14e-eed9-4356-9d06-4426325f4a2a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.047598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4d14e-eed9-4356-9d06-4426325f4a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.055595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c79b3a-b0d4-4f3e-ab8f-483f2c2779a6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.055886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c79b3a-b0d4-4f3e-ab8f-483f2c2779a6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.056337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c79b3a-b0d4-4f3e-ab8f-483f2c2779a6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.058891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:38.065039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248332d-b50d-445b-930a-4ec6f2597762 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.065595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248332d-b50d-445b-930a-4ec6f2597762 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.066055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248332d-b50d-445b-930a-4ec6f2597762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.070580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f9b4d14e-eed9-4356-9d06-4426325f4a2a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:38.071905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f9b4d14e-eed9-4356-9d06-4426325f4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:38.084736 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a248332d-b50d-445b-930a-4ec6f2597762 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:38.086305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a248332d-b50d-445b-930a-4ec6f2597762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:38.149797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 33/64] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:38.185218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4d14e-eed9-4356-9d06-4426325f4a2a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:38.194376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 32/65] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:38.228875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30655f-1616-4b7c-8a4e-c1397f2c83a9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.230246 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30655f-1616-4b7c-8a4e-c1397f2c83a9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.230833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30655f-1616-4b7c-8a4e-c1397f2c83a9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.232667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 33/66] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:38.233659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30655f-1616-4b7c-8a4e-c1397f2c83a9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:38.295025 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4d14e-eed9-4356-9d06-4426325f4a2a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:38.331734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b116d-3644-4e4b-aa89-fc50ae4940e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:38.332941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b116d-3644-4e4b-aa89-fc50ae4940e2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.333441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b116d-3644-4e4b-aa89-fc50ae4940e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.333731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b116d-3644-4e4b-aa89-fc50ae4940e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.345229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b116d-3644-4e4b-aa89-fc50ae4940e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-799b116d-3644-4e4b-aa89-fc50ae4940e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:38.353454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:38.355040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:38.355971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 34/67] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:16:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:38.356869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69928a-7231-49c3-bcd3-cee2b050929c None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.357391 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69928a-7231-49c3-bcd3-cee2b050929c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.357865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69928a-7231-49c3-bcd3-cee2b050929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.371694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30655f-1616-4b7c-8a4e-c1397f2c83a9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:38.374988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-cc69928a-7231-49c3-bcd3-cee2b050929c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:38.376194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-cc69928a-7231-49c3-bcd3-cee2b050929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:38.407746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12029218-ddf1-405e-8741-d1754150a414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:38.408474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029218-ddf1-405e-8741-d1754150a414 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.408942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029218-ddf1-405e-8741-d1754150a414 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.409224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12029218-ddf1-405e-8741-d1754150a414 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.421918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12029218-ddf1-405e-8741-d1754150a414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-12029218-ddf1-405e-8741-d1754150a414 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:38.430957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:38.431815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:16:38.432687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 34/68] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:38.434247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137a1e-ee22-4e20-b66b-05022598dd21 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.434459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137a1e-ee22-4e20-b66b-05022598dd21 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.434743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137a1e-ee22-4e20-b66b-05022598dd21 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.436133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 35/69] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:38.440604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b137a1e-ee22-4e20-b66b-05022598dd21 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:38.453511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 35/70] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:38.453511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69928a-7231-49c3-bcd3-cee2b050929c None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:38.547186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b137a1e-ee22-4e20-b66b-05022598dd21 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:38.553950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69928a-7231-49c3-bcd3-cee2b050929c None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:38.579955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fa7a7-1b47-4e57-92c7-f86c99320ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:38.580626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fa7a7-1b47-4e57-92c7-f86c99320ecc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.580914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fa7a7-1b47-4e57-92c7-f86c99320ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.581193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fa7a7-1b47-4e57-92c7-f86c99320ecc None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.581976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fa7a7-1b47-4e57-92c7-f86c99320ecc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:38.582283 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fa7a7-1b47-4e57-92c7-f86c99320ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:38.583660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fa7a7-1b47-4e57-92c7-f86c99320ecc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:38.586866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f481e-c4ff-40cc-a1be-92e240018fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:38.587535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f481e-c4ff-40cc-a1be-92e240018fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.587827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f481e-c4ff-40cc-a1be-92e240018fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.588111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f481e-c4ff-40cc-a1be-92e240018fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.589771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f481e-c4ff-40cc-a1be-92e240018fa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:38.590086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f481e-c4ff-40cc-a1be-92e240018fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:38.591475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f481e-c4ff-40cc-a1be-92e240018fa9 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:38.592286 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 36/71] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:16:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:38.593701 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64100c3-fc1e-41a7-9db1-2c5170ee5b2b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.593793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64100c3-fc1e-41a7-9db1-2c5170ee5b2b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.594048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64100c3-fc1e-41a7-9db1-2c5170ee5b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.600909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 36/72] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:16:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:38.601753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f481e-c4ff-40cc-a1be-92e240018fa9 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:38.610480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f64100c3-fc1e-41a7-9db1-2c5170ee5b2b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:38.611669 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f64100c3-fc1e-41a7-9db1-2c5170ee5b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:38.681745 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 37/73] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:38.683574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d397fa8-80f2-4e3b-bb71-3aba02f55e08 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.683956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d397fa8-80f2-4e3b-bb71-3aba02f55e08 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.684309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d397fa8-80f2-4e3b-bb71-3aba02f55e08 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.685800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 38/74] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:38.690191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d397fa8-80f2-4e3b-bb71-3aba02f55e08 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:38.714759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f481e-c4ff-40cc-a1be-92e240018fa9 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:38.748590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7ad12-506d-4de3-8a67-430d442853d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:38.749495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7ad12-506d-4de3-8a67-430d442853d6 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.749792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7ad12-506d-4de3-8a67-430d442853d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.750074 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7ad12-506d-4de3-8a67-430d442853d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.760543 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7ad12-506d-4de3-8a67-430d442853d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-a4b7ad12-506d-4de3-8a67-430d442853d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:38.768374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:38.769208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:38.770013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:16:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:38.770650 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7ad12-506d-4de3-8a67-430d442853d6 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:38.799414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d397fa8-80f2-4e3b-bb71-3aba02f55e08 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:38.833401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185fa3e-a7af-43ef-b3e6-7c4bda1c391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:38.834286 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185fa3e-a7af-43ef-b3e6-7c4bda1c391d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.834575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185fa3e-a7af-43ef-b3e6-7c4bda1c391d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.834857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185fa3e-a7af-43ef-b3e6-7c4bda1c391d None admin] PATH_INFO: `/v3/users/7426c40478b347618984700782b5b8b6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.850802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185fa3e-a7af-43ef-b3e6-7c4bda1c391d None admin] RBAC: Authorizing `identity:get_user(user_id=7426c40478b347618984700782b5b8b6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:38.852269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185fa3e-a7af-43ef-b3e6-7c4bda1c391d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:38.854036 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 39/76] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:38 2022] GET /identity/v3/users/7426c40478b347618984700782b5b8b6 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:38.855584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde224f8-4507-41c0-a24c-29d2c9e9692e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.855894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde224f8-4507-41c0-a24c-29d2c9e9692e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.856156 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde224f8-4507-41c0-a24c-29d2c9e9692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.874172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-bde224f8-4507-41c0-a24c-29d2c9e9692e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:38.875389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bde224f8-4507-41c0-a24c-29d2c9e9692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:38.882790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7ad12-506d-4de3-8a67-430d442853d6 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:38.917506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768990-3d66-40e6-ab51-88d4c38c6e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:38.918406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768990-3d66-40e6-ab51-88d4c38c6e81 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:38.918694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768990-3d66-40e6-ab51-88d4c38c6e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:38.918977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62768990-3d66-40e6-ab51-88d4c38c6e81 None admin] PATH_INFO: `/v3/users/7426c40478b347618984700782b5b8b6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:38.920265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62768990-3d66-40e6-ab51-88d4c38c6e81 None admin] RBAC: Authorizing `identity:get_user(user_id=7426c40478b347618984700782b5b8b6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:38.923273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62768990-3d66-40e6-ab51-88d4c38c6e81 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:38.925804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 38/77] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:38 2022] GET /identity/v3/users/7426c40478b347618984700782b5b8b6 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:38.926613 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768990-3d66-40e6-ab51-88d4c38c6e81 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:38.947801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 40/78] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:38.949568 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde224f8-4507-41c0-a24c-29d2c9e9692e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.037171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62768990-3d66-40e6-ab51-88d4c38c6e81 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.066793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde224f8-4507-41c0-a24c-29d2c9e9692e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.072350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abe275-0e07-436d-9523-91a5dd64b213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.074526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abe275-0e07-436d-9523-91a5dd64b213 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.074889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abe275-0e07-436d-9523-91a5dd64b213 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.075172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abe275-0e07-436d-9523-91a5dd64b213 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.085603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abe275-0e07-436d-9523-91a5dd64b213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-d8abe275-0e07-436d-9523-91a5dd64b213 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:39.093903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:39.094851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:39.095603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 39/79] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:39.096238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abe275-0e07-436d-9523-91a5dd64b213 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.105731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b49135-9d80-46c9-b278-765441447a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.106415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b49135-9d80-46c9-b278-765441447a8e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.106703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b49135-9d80-46c9-b278-765441447a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.106984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b49135-9d80-46c9-b278-765441447a8e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.107750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b49135-9d80-46c9-b278-765441447a8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:39.108064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b49135-9d80-46c9-b278-765441447a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:39.109481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b49135-9d80-46c9-b278-765441447a8e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:39.117641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 41/80] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:39.118470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b49135-9d80-46c9-b278-765441447a8e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.195958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abe275-0e07-436d-9523-91a5dd64b213 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.217756 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b49135-9d80-46c9-b278-765441447a8e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.228906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761288e6-6179-40b7-ac98-dfc4a4acd3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.229780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761288e6-6179-40b7-ac98-dfc4a4acd3fc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.230717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761288e6-6179-40b7-ac98-dfc4a4acd3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.230717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761288e6-6179-40b7-ac98-dfc4a4acd3fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.252880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f776eb-8392-48ae-8a92-9030982c3911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.253591 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f776eb-8392-48ae-8a92-9030982c3911 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.253875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f776eb-8392-48ae-8a92-9030982c3911 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.254152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f776eb-8392-48ae-8a92-9030982c3911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.302292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761288e6-6179-40b7-ac98-dfc4a4acd3fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:39.303776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761288e6-6179-40b7-ac98-dfc4a4acd3fc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:39.321539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f776eb-8392-48ae-8a92-9030982c3911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:39.324202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f776eb-8392-48ae-8a92-9030982c3911 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:39.397653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 40/81] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:39.398506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761288e6-6179-40b7-ac98-dfc4a4acd3fc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.422963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 42/82] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:39.422963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f776eb-8392-48ae-8a92-9030982c3911 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.492782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761288e6-6179-40b7-ac98-dfc4a4acd3fc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.513089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f776eb-8392-48ae-8a92-9030982c3911 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.525309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f35af3-97f0-4029-be8b-be5b651975a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.526960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f35af3-97f0-4029-be8b-be5b651975a6 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.527429 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f35af3-97f0-4029-be8b-be5b651975a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.527757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f35af3-97f0-4029-be8b-be5b651975a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.528965 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f35af3-97f0-4029-be8b-be5b651975a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:39.530460 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f35af3-97f0-4029-be8b-be5b651975a6 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:39.532068 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 41/83] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:39.532841 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f35af3-97f0-4029-be8b-be5b651975a6 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.546287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c73a2-bfad-4b59-b966-81fa1bca81dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.546957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c73a2-bfad-4b59-b966-81fa1bca81dc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.547245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c73a2-bfad-4b59-b966-81fa1bca81dc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.547525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c73a2-bfad-4b59-b966-81fa1bca81dc None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.548275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c73a2-bfad-4b59-b966-81fa1bca81dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:39.548584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c73a2-bfad-4b59-b966-81fa1bca81dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:39.549997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c73a2-bfad-4b59-b966-81fa1bca81dc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:39.558640 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 43/84] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:16:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:39.559422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c73a2-bfad-4b59-b966-81fa1bca81dc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.627484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f35af3-97f0-4029-be8b-be5b651975a6 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.653609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c73a2-bfad-4b59-b966-81fa1bca81dc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.659427 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b96546-9bae-4abd-be54-f17f99332413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.660306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96546-9bae-4abd-be54-f17f99332413 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.660592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96546-9bae-4abd-be54-f17f99332413 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.660874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96546-9bae-4abd-be54-f17f99332413 None admin] PATH_INFO: `/v3/users/4a85c2f6540a47cfa927556bdcddaf95` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.662089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b96546-9bae-4abd-be54-f17f99332413 None admin] RBAC: Authorizing `identity:get_user(user_id=4a85c2f6540a47cfa927556bdcddaf95)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:39.663530 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b96546-9bae-4abd-be54-f17f99332413 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:39.665133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 42/85] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:39 2022] GET /identity/v3/users/4a85c2f6540a47cfa927556bdcddaf95 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:39.665934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b96546-9bae-4abd-be54-f17f99332413 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.687821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5c157-1a90-4726-8016-de45a842e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.688696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5c157-1a90-4726-8016-de45a842e90a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.688985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5c157-1a90-4726-8016-de45a842e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.689293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5c157-1a90-4726-8016-de45a842e90a None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.690498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5c157-1a90-4726-8016-de45a842e90a None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:39.691938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5c157-1a90-4726-8016-de45a842e90a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:39.693668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 44/86] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:39 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:39.694414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5c157-1a90-4726-8016-de45a842e90a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.761198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b96546-9bae-4abd-be54-f17f99332413 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.789049 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5c157-1a90-4726-8016-de45a842e90a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.793435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f6ea8-8207-43d5-8898-547c9a5ad516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.794297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6ea8-8207-43d5-8898-547c9a5ad516 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.794583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6ea8-8207-43d5-8898-547c9a5ad516 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.794861 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6ea8-8207-43d5-8898-547c9a5ad516 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.796040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f6ea8-8207-43d5-8898-547c9a5ad516 None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:39.797502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f6ea8-8207-43d5-8898-547c9a5ad516 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:39.799189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 43/87] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:39 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:39.799950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f6ea8-8207-43d5-8898-547c9a5ad516 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.821576 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909a461-2200-4d18-b242-e98d60c417f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.822242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909a461-2200-4d18-b242-e98d60c417f1 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.822530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909a461-2200-4d18-b242-e98d60c417f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.822864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909a461-2200-4d18-b242-e98d60c417f1 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.823534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909a461-2200-4d18-b242-e98d60c417f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:39.824964 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909a461-2200-4d18-b242-e98d60c417f1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:39.894431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f6ea8-8207-43d5-8898-547c9a5ad516 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:39.927427 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15d02b-890b-4dd7-bfd3-f5ba93166c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:39.928303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15d02b-890b-4dd7-bfd3-f5ba93166c3d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:39.928596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15d02b-890b-4dd7-bfd3-f5ba93166c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:39.928899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15d02b-890b-4dd7-bfd3-f5ba93166c3d None admin] PATH_INFO: `/v3/users/7426c40478b347618984700782b5b8b6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:39.930129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15d02b-890b-4dd7-bfd3-f5ba93166c3d None admin] RBAC: Authorizing `identity:get_user(user_id=7426c40478b347618984700782b5b8b6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:39.931583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15d02b-890b-4dd7-bfd3-f5ba93166c3d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:39.933478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 44/88] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:39 2022] GET /identity/v3/users/7426c40478b347618984700782b5b8b6 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:39.934246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15d02b-890b-4dd7-bfd3-f5ba93166c3d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:39.944073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 45/89] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:16:39 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:16:39.945217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909a461-2200-4d18-b242-e98d60c417f1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:40.039865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15d02b-890b-4dd7-bfd3-f5ba93166c3d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:40.066384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909a461-2200-4d18-b242-e98d60c417f1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:40.075604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4ba2c-7660-4eb6-8ca1-9252f6171456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:40.076289 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ba2c-7660-4eb6-8ca1-9252f6171456 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:40.076573 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ba2c-7660-4eb6-8ca1-9252f6171456 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:40.076857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ba2c-7660-4eb6-8ca1-9252f6171456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:40.114681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808a878-a1ae-4fa7-b059-8ed336c5d7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:40.115976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808a878-a1ae-4fa7-b059-8ed336c5d7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:40.116271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808a878-a1ae-4fa7-b059-8ed336c5d7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:40.116557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808a878-a1ae-4fa7-b059-8ed336c5d7b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:40.117478 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808a878-a1ae-4fa7-b059-8ed336c5d7b7 None admin] RBAC: Adding query filter params (role.id=2f9013fc95d448a5b605f539fb6ae08f, scope.project.id=1a986d55348f4996bbf49674a39f2e34, user.id=7426c40478b347618984700782b5b8b6) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:40.117798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808a878-a1ae-4fa7-b059-8ed336c5d7b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:40.119292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808a878-a1ae-4fa7-b059-8ed336c5d7b7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:40.126606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 46/90] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:39 2022] GET /identity/v3/role_assignments?user.id=7426c40478b347618984700782b5b8b6&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=2f9013fc95d448a5b605f539fb6ae08f => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:40.127373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808a878-a1ae-4fa7-b059-8ed336c5d7b7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:40.171236 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4ba2c-7660-4eb6-8ca1-9252f6171456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:40.172735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4ba2c-7660-4eb6-8ca1-9252f6171456 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:40.267806 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808a878-a1ae-4fa7-b059-8ed336c5d7b7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:40.313414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 45/91] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:40.313414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4ba2c-7660-4eb6-8ca1-9252f6171456 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:40.322498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ce667-0c6f-4418-ac83-9a347e267e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:40.324398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ce667-0c6f-4418-ac83-9a347e267e02 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:40.324691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ce667-0c6f-4418-ac83-9a347e267e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:40.324981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ce667-0c6f-4418-ac83-9a347e267e02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:40.325889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ce667-0c6f-4418-ac83-9a347e267e02 None admin] RBAC: Adding query filter params (role.id=4982f0e43bc8430d81d3906431eff62e, scope.project.id=1a986d55348f4996bbf49674a39f2e34, user.id=7426c40478b347618984700782b5b8b6) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:40.326254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ce667-0c6f-4418-ac83-9a347e267e02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:40.328982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ce667-0c6f-4418-ac83-9a347e267e02 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:40.340881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 47/92] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:40 2022] GET /identity/v3/role_assignments?user.id=7426c40478b347618984700782b5b8b6&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=4982f0e43bc8430d81d3906431eff62e => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:40.341880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ce667-0c6f-4418-ac83-9a347e267e02 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:40.471961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4ba2c-7660-4eb6-8ca1-9252f6171456 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:40.517210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ce667-0c6f-4418-ac83-9a347e267e02 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:40.542752 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955311d6-0970-4178-9b9a-fe45579a0510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:40.543426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955311d6-0970-4178-9b9a-fe45579a0510 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:40.543704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955311d6-0970-4178-9b9a-fe45579a0510 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:40.543988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955311d6-0970-4178-9b9a-fe45579a0510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:40.591881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560f57b-a749-461e-8a39-0c5a884c5bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:40.592546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560f57b-a749-461e-8a39-0c5a884c5bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:40.592829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560f57b-a749-461e-8a39-0c5a884c5bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:40.593109 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560f57b-a749-461e-8a39-0c5a884c5bb8 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:40.594897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560f57b-a749-461e-8a39-0c5a884c5bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:40.595880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560f57b-a749-461e-8a39-0c5a884c5bb8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:40.598539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 48/93] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:40 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:40.605461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560f57b-a749-461e-8a39-0c5a884c5bb8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:40.708914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955311d6-0970-4178-9b9a-fe45579a0510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:40.710445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955311d6-0970-4178-9b9a-fe45579a0510 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:40.769044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560f57b-a749-461e-8a39-0c5a884c5bb8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:40.839415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 46/94] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:40.845130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955311d6-0970-4178-9b9a-fe45579a0510 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:40.846526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b511fb-e132-4e0d-8b8e-8cffea0344bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:40.847310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b511fb-e132-4e0d-8b8e-8cffea0344bb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:40.847689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b511fb-e132-4e0d-8b8e-8cffea0344bb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:40.848178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b511fb-e132-4e0d-8b8e-8cffea0344bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:40.849253 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b511fb-e132-4e0d-8b8e-8cffea0344bb None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=1a986d55348f4996bbf49674a39f2e34, user.id=4a85c2f6540a47cfa927556bdcddaf95) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:40.849807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b511fb-e132-4e0d-8b8e-8cffea0344bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:40.851468 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b511fb-e132-4e0d-8b8e-8cffea0344bb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:40.867293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 49/95] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:40 2022] GET /identity/v3/role_assignments?user.id=4a85c2f6540a47cfa927556bdcddaf95&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=4ae0665802b946be870ab06274297a1d => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:40.957013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955311d6-0970-4178-9b9a-fe45579a0510 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:40.999998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6e0e8-4624-44dc-9aa7-c98720922070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:41.000901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e0e8-4624-44dc-9aa7-c98720922070 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:41.001196 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e0e8-4624-44dc-9aa7-c98720922070 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:41.001504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e0e8-4624-44dc-9aa7-c98720922070 None admin] PATH_INFO: `/v3/projects/3d50dbac76b84572a22c3f79c86687da` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:41.002833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6e0e8-4624-44dc-9aa7-c98720922070 None admin] RBAC: Authorizing `identity:get_project(project_id=3d50dbac76b84572a22c3f79c86687da)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:41.004829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6e0e8-4624-44dc-9aa7-c98720922070 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:41.006598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 47/96] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:40 2022] GET /identity/v3/projects/3d50dbac76b84572a22c3f79c86687da => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:41.018427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b511fb-e132-4e0d-8b8e-8cffea0344bb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:41.179734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b511fb-e132-4e0d-8b8e-8cffea0344bb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:41.220478 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95461313-0648-4a73-91ad-eac4a330d459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:41.221586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95461313-0648-4a73-91ad-eac4a330d459 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:41.222089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95461313-0648-4a73-91ad-eac4a330d459 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:41.222561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95461313-0648-4a73-91ad-eac4a330d459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:41.223602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95461313-0648-4a73-91ad-eac4a330d459 None admin] RBAC: Adding query filter params (role.id=4982f0e43bc8430d81d3906431eff62e, scope.project.id=3d50dbac76b84572a22c3f79c86687da, user.id=7426c40478b347618984700782b5b8b6) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:41.224112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95461313-0648-4a73-91ad-eac4a330d459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:41.225814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95461313-0648-4a73-91ad-eac4a330d459 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:41.232793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 50/97] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:41 2022] GET /identity/v3/role_assignments?user.id=7426c40478b347618984700782b5b8b6&scope.project.id=3d50dbac76b84572a22c3f79c86687da&role.id=4982f0e43bc8430d81d3906431eff62e => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:43.208772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3a2d-c034-4811-84f9-dc7acf905976 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:43.209716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3a2d-c034-4811-84f9-dc7acf905976 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:43.210146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3a2d-c034-4811-84f9-dc7acf905976 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:43.211955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 48/98] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:43.217421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578f22b-ceba-49c5-8dcc-ff01dc7727a9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:43.218246 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578f22b-ceba-49c5-8dcc-ff01dc7727a9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:43.218692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578f22b-ceba-49c5-8dcc-ff01dc7727a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:43.242083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4578f22b-ceba-49c5-8dcc-ff01dc7727a9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:43.243515 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4578f22b-ceba-49c5-8dcc-ff01dc7727a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:43.337176 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09730c-e407-4ab1-9cf0-daa295a5a2ee None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:43.337950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09730c-e407-4ab1-9cf0-daa295a5a2ee None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:43.338753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09730c-e407-4ab1-9cf0-daa295a5a2ee None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:43.341080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 49/99] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:43.342679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 51/100] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:43.351175 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ec65-1b4e-490d-a549-d7af1760db2a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:43.351782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ec65-1b4e-490d-a549-d7af1760db2a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:43.352270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ec65-1b4e-490d-a549-d7af1760db2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:43.372601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578f22b-ceba-49c5-8dcc-ff01dc7727a9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:43.386367 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-1f44ec65-1b4e-490d-a549-d7af1760db2a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:43.387951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1f44ec65-1b4e-490d-a549-d7af1760db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:43.518173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 50/101] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:43.535408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578f22b-ceba-49c5-8dcc-ff01dc7727a9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:43.584965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaf684-62bf-4554-9814-da41146b102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:43.585818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaf684-62bf-4554-9814-da41146b102e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:43.586108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaf684-62bf-4554-9814-da41146b102e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:43.586389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaf684-62bf-4554-9814-da41146b102e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:43.602828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaf684-62bf-4554-9814-da41146b102e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:43.606958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44ec65-1b4e-490d-a549-d7af1760db2a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-6eeaf684-62bf-4554-9814-da41146b102e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:43.622517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:43.623476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:16:43.624270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 52/102] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:16:43.640561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaf684-62bf-4554-9814-da41146b102e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:43.774276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaf684-62bf-4554-9814-da41146b102e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:43.812472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a0a1-b2d6-4564-b155-a2de210bb8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:43.813855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a0a1-b2d6-4564-b155-a2de210bb8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:43.814313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a0a1-b2d6-4564-b155-a2de210bb8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:43.814729 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a0a1-b2d6-4564-b155-a2de210bb8d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:43.815620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a0a1-b2d6-4564-b155-a2de210bb8d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:43.816057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a0a1-b2d6-4564-b155-a2de210bb8d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:43.817609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a0a1-b2d6-4564-b155-a2de210bb8d3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:43.827922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 53/103] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:16:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:43.833854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802528e-2071-4024-a505-3a863be52cac None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:43.834452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802528e-2071-4024-a505-3a863be52cac None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:43.834885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802528e-2071-4024-a505-3a863be52cac None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:43.836995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 54/104] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:43.843405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802528e-2071-4024-a505-3a863be52cac None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:43.869299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44ec65-1b4e-490d-a549-d7af1760db2a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:43.956839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802528e-2071-4024-a505-3a863be52cac None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:43.986020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8390ff1-df88-4150-b53c-2cac15f2b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:43.986863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8390ff1-df88-4150-b53c-2cac15f2b557 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:43.987161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8390ff1-df88-4150-b53c-2cac15f2b557 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:43.987453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8390ff1-df88-4150-b53c-2cac15f2b557 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:43.994016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735a5f3-8cb0-40c8-9856-c88d1e451cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:43.996162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a5f3-8cb0-40c8-9856-c88d1e451cfa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:43.996457 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a5f3-8cb0-40c8-9856-c88d1e451cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:43.996739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a5f3-8cb0-40c8-9856-c88d1e451cfa None admin] PATH_INFO: `/v3/users/eab44cdae75b4a41b963f86a8fa0ec4d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.012609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735a5f3-8cb0-40c8-9856-c88d1e451cfa None admin] RBAC: Authorizing `identity:get_user(user_id=eab44cdae75b4a41b963f86a8fa0ec4d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:44.014157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735a5f3-8cb0-40c8-9856-c88d1e451cfa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:44.015883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 55/105] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:43 2022] GET /identity/v3/users/eab44cdae75b4a41b963f86a8fa0ec4d => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:44.016939 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8390ff1-df88-4150-b53c-2cac15f2b557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:44.017236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1c299-c701-49bb-abb5-a1b2339fb1f7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.021881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1c299-c701-49bb-abb5-a1b2339fb1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.022188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1c299-c701-49bb-abb5-a1b2339fb1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-d8390ff1-df88-4150-b53c-2cac15f2b557 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:44.025130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:44.026030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:16:44.026784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:44.034514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 51/106] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:16:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:44.035376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8390ff1-df88-4150-b53c-2cac15f2b557 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:44.040082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0da1c299-c701-49bb-abb5-a1b2339fb1f7 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:44.041911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0da1c299-c701-49bb-abb5-a1b2339fb1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:44.137967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 56/107] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:44.145300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1c299-c701-49bb-abb5-a1b2339fb1f7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:44.177355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8390ff1-df88-4150-b53c-2cac15f2b557 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:44.221301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd32e9-766d-407d-bbc6-51d9719f06f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:44.222657 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd32e9-766d-407d-bbc6-51d9719f06f0 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.223096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd32e9-766d-407d-bbc6-51d9719f06f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.223524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd32e9-766d-407d-bbc6-51d9719f06f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.264139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1c299-c701-49bb-abb5-a1b2339fb1f7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:44.300916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd32e9-766d-407d-bbc6-51d9719f06f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:44.302790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd32e9-766d-407d-bbc6-51d9719f06f0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:44.306465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c16fab-fd1f-436c-8339-bb9b03365367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:44.307228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16fab-fd1f-436c-8339-bb9b03365367 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.307675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16fab-fd1f-436c-8339-bb9b03365367 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.308231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16fab-fd1f-436c-8339-bb9b03365367 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.309045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c16fab-fd1f-436c-8339-bb9b03365367 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:44.309397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c16fab-fd1f-436c-8339-bb9b03365367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:44.310800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c16fab-fd1f-436c-8339-bb9b03365367 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:44.319612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 57/108] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:16:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:44.325561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00074bbf-90fe-46bb-8331-0bc30beabbc7 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.325875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00074bbf-90fe-46bb-8331-0bc30beabbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.326149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00074bbf-90fe-46bb-8331-0bc30beabbc7 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.331714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 58/109] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:44.331714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00074bbf-90fe-46bb-8331-0bc30beabbc7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:44.449888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 52/110] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:44.451600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7aad3-8ad8-40cb-a191-5ec94030bfb5 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.451958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7aad3-8ad8-40cb-a191-5ec94030bfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.452245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7aad3-8ad8-40cb-a191-5ec94030bfb5 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.453909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 53/111] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:44.458549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7aad3-8ad8-40cb-a191-5ec94030bfb5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:44.475200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00074bbf-90fe-46bb-8331-0bc30beabbc7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:44.518024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21d0a4-9c8f-4d20-a91a-986748794c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:44.518832 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d0a4-9c8f-4d20-a91a-986748794c7d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.519121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d0a4-9c8f-4d20-a91a-986748794c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.519493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d0a4-9c8f-4d20-a91a-986748794c7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.520705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21d0a4-9c8f-4d20-a91a-986748794c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:44.522356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21d0a4-9c8f-4d20-a91a-986748794c7d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:44.529318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 59/112] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:44.529318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde8a0-0b5e-480e-92fb-d255d486dcb9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.529318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde8a0-0b5e-480e-92fb-d255d486dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.529318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde8a0-0b5e-480e-92fb-d255d486dcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.546297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a3dde8a0-0b5e-480e-92fb-d255d486dcb9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:44.547502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a3dde8a0-0b5e-480e-92fb-d255d486dcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:44.595098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7aad3-8ad8-40cb-a191-5ec94030bfb5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:44.627435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 60/113] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:44.628324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dde8a0-0b5e-480e-92fb-d255d486dcb9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:44.656585 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f80c09-c0ef-45c2-b504-fd4ebf8c2565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:44.657558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80c09-c0ef-45c2-b504-fd4ebf8c2565 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.657849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80c09-c0ef-45c2-b504-fd4ebf8c2565 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.658126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80c09-c0ef-45c2-b504-fd4ebf8c2565 None admin] PATH_INFO: `/v3/users/7426c40478b347618984700782b5b8b6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.659365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80c09-c0ef-45c2-b504-fd4ebf8c2565 None admin] RBAC: Authorizing `identity:get_user(user_id=7426c40478b347618984700782b5b8b6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:44.660850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80c09-c0ef-45c2-b504-fd4ebf8c2565 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:44.665335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 54/114] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:44 2022] GET /identity/v3/users/7426c40478b347618984700782b5b8b6 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:44.665335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0e2ff-1c3b-4de3-a094-b292f307fb15 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.665335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0e2ff-1c3b-4de3-a094-b292f307fb15 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.665335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0e2ff-1c3b-4de3-a094-b292f307fb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.683525 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-7cd0e2ff-1c3b-4de3-a094-b292f307fb15 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:44.684723 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7cd0e2ff-1c3b-4de3-a094-b292f307fb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:44.753638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 55/115] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:44.754431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0e2ff-1c3b-4de3-a094-b292f307fb15 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:44.772755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dde8a0-0b5e-480e-92fb-d255d486dcb9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:44.812201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e3826-60ea-4235-8bf7-e79a955ed18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:44.813023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3826-60ea-4235-8bf7-e79a955ed18e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.813345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3826-60ea-4235-8bf7-e79a955ed18e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.813635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e3826-60ea-4235-8bf7-e79a955ed18e None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.814856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e3826-60ea-4235-8bf7-e79a955ed18e None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:44.816315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e3826-60ea-4235-8bf7-e79a955ed18e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:44.818089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 61/116] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:44 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:44.818896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e3826-60ea-4235-8bf7-e79a955ed18e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:44.857471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0e2ff-1c3b-4de3-a094-b292f307fb15 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:44.892063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d16fd-60fe-46b8-9ceb-303e78b39b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:44.892745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d16fd-60fe-46b8-9ceb-303e78b39b4b None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.893041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d16fd-60fe-46b8-9ceb-303e78b39b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.893352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d16fd-60fe-46b8-9ceb-303e78b39b4b None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.894168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d16fd-60fe-46b8-9ceb-303e78b39b4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:44.895633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d16fd-60fe-46b8-9ceb-303e78b39b4b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:44.918135 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e3826-60ea-4235-8bf7-e79a955ed18e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:44.953041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726b845-3f55-45a9-83ed-d03c57998db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:44.953871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726b845-3f55-45a9-83ed-d03c57998db1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:44.954156 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726b845-3f55-45a9-83ed-d03c57998db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:44.954500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726b845-3f55-45a9-83ed-d03c57998db1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:44.964966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726b845-3f55-45a9-83ed-d03c57998db1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b726b845-3f55-45a9-83ed-d03c57998db1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:44.972769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:44.973828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 62/117] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:44.974813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726b845-3f55-45a9-83ed-d03c57998db1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:44.987200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 56/118] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:16:44 2022] POST /identity/v3/projects => generated 302 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:16:44.995929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d16fd-60fe-46b8-9ceb-303e78b39b4b None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:45.095439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726b845-3f55-45a9-83ed-d03c57998db1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:45.116971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d16fd-60fe-46b8-9ceb-303e78b39b4b None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:45.134055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69692a-8155-4aca-8566-e7a2f5179393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:45.135523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69692a-8155-4aca-8566-e7a2f5179393 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:45.136105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69692a-8155-4aca-8566-e7a2f5179393 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:45.136305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69692a-8155-4aca-8566-e7a2f5179393 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:45.138445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69692a-8155-4aca-8566-e7a2f5179393 None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:45.139984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69692a-8155-4aca-8566-e7a2f5179393 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:45.141860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 63/119] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:44 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:45.143196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a08ee-a00d-4449-af98-6cf823c4e332 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:45.143494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a08ee-a00d-4449-af98-6cf823c4e332 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:45.143781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a08ee-a00d-4449-af98-6cf823c4e332 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:45.149319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 64/120] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:45.149319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a08ee-a00d-4449-af98-6cf823c4e332 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:45.163776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f486e-a349-43b4-801b-6eab195fc71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:45.164743 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f486e-a349-43b4-801b-6eab195fc71e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:45.165106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f486e-a349-43b4-801b-6eab195fc71e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:45.165500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f486e-a349-43b4-801b-6eab195fc71e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:45.177222 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f486e-a349-43b4-801b-6eab195fc71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-b05f486e-a349-43b4-801b-6eab195fc71e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:45.185998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:45.187128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:45.187888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 57/121] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:16:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:45.188540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f486e-a349-43b4-801b-6eab195fc71e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:45.267012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a08ee-a00d-4449-af98-6cf823c4e332 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:45.294246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f486e-a349-43b4-801b-6eab195fc71e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:45.302133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218259c7-0c8d-43d1-b5a4-fd0f2a80405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:45.302803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218259c7-0c8d-43d1-b5a4-fd0f2a80405e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:45.303090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218259c7-0c8d-43d1-b5a4-fd0f2a80405e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:45.303373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218259c7-0c8d-43d1-b5a4-fd0f2a80405e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:45.307440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218259c7-0c8d-43d1-b5a4-fd0f2a80405e None admin] RBAC: Adding query filter params (role.id=ef402940c145454090aa4eba58af85bf, scope.project.id=1a986d55348f4996bbf49674a39f2e34, user.id=eab44cdae75b4a41b963f86a8fa0ec4d) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:45.307440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218259c7-0c8d-43d1-b5a4-fd0f2a80405e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:45.307440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218259c7-0c8d-43d1-b5a4-fd0f2a80405e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:45.313349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 65/122] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:45 2022] GET /identity/v3/role_assignments?user.id=eab44cdae75b4a41b963f86a8fa0ec4d&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=ef402940c145454090aa4eba58af85bf => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:45.322574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218259c7-0c8d-43d1-b5a4-fd0f2a80405e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:45.341870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e2480-54fb-411a-a1e1-1f5d19b4cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:45.343429 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e2480-54fb-411a-a1e1-1f5d19b4cb5a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:45.343943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e2480-54fb-411a-a1e1-1f5d19b4cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:45.344450 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e2480-54fb-411a-a1e1-1f5d19b4cb5a None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:45.345918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e2480-54fb-411a-a1e1-1f5d19b4cb5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:45.346479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e2480-54fb-411a-a1e1-1f5d19b4cb5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:45.349197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e2480-54fb-411a-a1e1-1f5d19b4cb5a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:45.372226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 58/123] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:16:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:45.372226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c249-6d97-4f38-b348-678e1b78543d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:45.372226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c249-6d97-4f38-b348-678e1b78543d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:45.372226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0c249-6d97-4f38-b348-678e1b78543d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:45.392024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-3fe0c249-6d97-4f38-b348-678e1b78543d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:45.393792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3fe0c249-6d97-4f38-b348-678e1b78543d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:45.467907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218259c7-0c8d-43d1-b5a4-fd0f2a80405e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:45.479781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 59/124] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:45.481161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c249-6d97-4f38-b348-678e1b78543d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:45.507470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70a5bb-a95e-4c05-ba7a-f1efab89be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:45.508633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70a5bb-a95e-4c05-ba7a-f1efab89be68 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:45.509006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70a5bb-a95e-4c05-ba7a-f1efab89be68 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:45.509426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70a5bb-a95e-4c05-ba7a-f1efab89be68 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34/users/7426c40478b347618984700782b5b8b6/roles/2f9013fc95d448a5b605f539fb6ae08f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:45.512275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70a5bb-a95e-4c05-ba7a-f1efab89be68 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a986d55348f4996bbf49674a39f2e34, user_id=7426c40478b347618984700782b5b8b6, role_id=2f9013fc95d448a5b605f539fb6ae08f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:45.514006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70a5bb-a95e-4c05-ba7a-f1efab89be68 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:45.596720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0c249-6d97-4f38-b348-678e1b78543d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:45.616311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 66/125] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:16:45 2022] PUT /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34/users/7426c40478b347618984700782b5b8b6/roles/2f9013fc95d448a5b605f539fb6ae08f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:16:45.622133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70a5bb-a95e-4c05-ba7a-f1efab89be68 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:45.692761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef62c3-1c31-43b3-8bbe-611791aca375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:45.693781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef62c3-1c31-43b3-8bbe-611791aca375 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:45.696206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef62c3-1c31-43b3-8bbe-611791aca375 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:45.696729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef62c3-1c31-43b3-8bbe-611791aca375 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:45.700137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef62c3-1c31-43b3-8bbe-611791aca375 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:45.701034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef62c3-1c31-43b3-8bbe-611791aca375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:45.702755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef62c3-1c31-43b3-8bbe-611791aca375 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:45.730742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 60/126] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:45.732649 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef62c3-1c31-43b3-8bbe-611791aca375 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:45.857571 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70a5bb-a95e-4c05-ba7a-f1efab89be68 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:45.909194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cf9ea-9c5c-4d76-ab68-292d325afb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:45.911496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cf9ea-9c5c-4d76-ab68-292d325afb2a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:45.911990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cf9ea-9c5c-4d76-ab68-292d325afb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:45.912473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cf9ea-9c5c-4d76-ab68-292d325afb2a None admin] PATH_INFO: `/v3/users/7426c40478b347618984700782b5b8b6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:45.915621 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cf9ea-9c5c-4d76-ab68-292d325afb2a None admin] RBAC: Authorizing `identity:get_user(user_id=7426c40478b347618984700782b5b8b6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:45.921050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cf9ea-9c5c-4d76-ab68-292d325afb2a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:45.924525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 67/127] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:45 2022] GET /identity/v3/users/7426c40478b347618984700782b5b8b6 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:45.925660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cf9ea-9c5c-4d76-ab68-292d325afb2a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:45.936925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef62c3-1c31-43b3-8bbe-611791aca375 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:46.027188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b3ecc-8936-408a-97e4-2399bea5d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:46.027933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b3ecc-8936-408a-97e4-2399bea5d92d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:46.028218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b3ecc-8936-408a-97e4-2399bea5d92d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:46.028496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b3ecc-8936-408a-97e4-2399bea5d92d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:46.048690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b3ecc-8936-408a-97e4-2399bea5d92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-db1b3ecc-8936-408a-97e4-2399bea5d92d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:46.060946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:46.062189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:46.062954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 61/128] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:46.063822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b3ecc-8936-408a-97e4-2399bea5d92d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:46.127485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cf9ea-9c5c-4d76-ab68-292d325afb2a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:46.193760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e44d0-ae62-474f-9d20-2d2a13546724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:46.195104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e44d0-ae62-474f-9d20-2d2a13546724 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:46.195600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e44d0-ae62-474f-9d20-2d2a13546724 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:46.196086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e44d0-ae62-474f-9d20-2d2a13546724 None admin] PATH_INFO: `/v3/users/4a85c2f6540a47cfa927556bdcddaf95` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:46.197779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e44d0-ae62-474f-9d20-2d2a13546724 None admin] RBAC: Authorizing `identity:get_user(user_id=4a85c2f6540a47cfa927556bdcddaf95)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:46.199526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e44d0-ae62-474f-9d20-2d2a13546724 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:46.201489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 68/129] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:45 2022] GET /identity/v3/users/4a85c2f6540a47cfa927556bdcddaf95 => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:46.202583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e44d0-ae62-474f-9d20-2d2a13546724 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:46.235876 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b3ecc-8936-408a-97e4-2399bea5d92d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:46.273759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad282a2-29b8-49b0-a899-5bce1a04af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:46.275017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad282a2-29b8-49b0-a899-5bce1a04af5e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:46.275519 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad282a2-29b8-49b0-a899-5bce1a04af5e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:46.276036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad282a2-29b8-49b0-a899-5bce1a04af5e None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:46.277616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad282a2-29b8-49b0-a899-5bce1a04af5e None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:46.279317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad282a2-29b8-49b0-a899-5bce1a04af5e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:46.281354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 62/130] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:46 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:46.282359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad282a2-29b8-49b0-a899-5bce1a04af5e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:46.411658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e44d0-ae62-474f-9d20-2d2a13546724 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:46.475450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa39d-b9ce-409e-98a6-09989888cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:46.477095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa39d-b9ce-409e-98a6-09989888cca5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:46.477925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa39d-b9ce-409e-98a6-09989888cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:46.478844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa39d-b9ce-409e-98a6-09989888cca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:46.481182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fa39d-b9ce-409e-98a6-09989888cca5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:46.481986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fa39d-b9ce-409e-98a6-09989888cca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:46.484912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fa39d-b9ce-409e-98a6-09989888cca5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:46.497360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad282a2-29b8-49b0-a899-5bce1a04af5e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:46.501726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 69/131] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:16:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:46.503370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa39d-b9ce-409e-98a6-09989888cca5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:46.567207 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51026f0-0a27-4434-8a6d-b412e8934105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:46.568026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51026f0-0a27-4434-8a6d-b412e8934105 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:46.568318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51026f0-0a27-4434-8a6d-b412e8934105 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:46.568604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51026f0-0a27-4434-8a6d-b412e8934105 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:46.574178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51026f0-0a27-4434-8a6d-b412e8934105 None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:46.575677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51026f0-0a27-4434-8a6d-b412e8934105 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:46.578591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 63/132] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:46 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:46.578591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51026f0-0a27-4434-8a6d-b412e8934105 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:46.693676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa39d-b9ce-409e-98a6-09989888cca5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:46.753377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e2c31-1afc-4fcb-92fa-134b03d50374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:46.755278 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e2c31-1afc-4fcb-92fa-134b03d50374 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:46.755987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e2c31-1afc-4fcb-92fa-134b03d50374 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:46.756627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e2c31-1afc-4fcb-92fa-134b03d50374 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34/users/7426c40478b347618984700782b5b8b6/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:46.761163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e2c31-1afc-4fcb-92fa-134b03d50374 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a986d55348f4996bbf49674a39f2e34, user_id=7426c40478b347618984700782b5b8b6, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:46.764188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e2c31-1afc-4fcb-92fa-134b03d50374 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:46.801971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51026f0-0a27-4434-8a6d-b412e8934105 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:46.839077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b2cfe-9363-4999-89f1-097b6f9e34eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:46.840044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b2cfe-9363-4999-89f1-097b6f9e34eb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:46.840390 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b2cfe-9363-4999-89f1-097b6f9e34eb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:46.840731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b2cfe-9363-4999-89f1-097b6f9e34eb None admin] PATH_INFO: `/v3/users/7426c40478b347618984700782b5b8b6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:46.842153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b2cfe-9363-4999-89f1-097b6f9e34eb None admin] RBAC: Authorizing `identity:get_user(user_id=7426c40478b347618984700782b5b8b6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:46.845470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b2cfe-9363-4999-89f1-097b6f9e34eb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:46.845470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 64/133] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:46 2022] GET /identity/v3/users/7426c40478b347618984700782b5b8b6 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:46.846435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b2cfe-9363-4999-89f1-097b6f9e34eb None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:46.884191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 70/134] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:16:46 2022] PUT /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34/users/7426c40478b347618984700782b5b8b6/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:16:46.894480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e2c31-1afc-4fcb-92fa-134b03d50374 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:47.026541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b2cfe-9363-4999-89f1-097b6f9e34eb None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:47.050619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e2c31-1afc-4fcb-92fa-134b03d50374 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:47.096290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891d569-7b8e-4266-a840-0e8d43d3061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:47.097096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891d569-7b8e-4266-a840-0e8d43d3061b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:47.097424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891d569-7b8e-4266-a840-0e8d43d3061b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:47.097717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891d569-7b8e-4266-a840-0e8d43d3061b None admin] PATH_INFO: `/v3/projects/3d50dbac76b84572a22c3f79c86687da` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:47.099254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891d569-7b8e-4266-a840-0e8d43d3061b None admin] RBAC: Authorizing `identity:get_project(project_id=3d50dbac76b84572a22c3f79c86687da)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:47.100733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891d569-7b8e-4266-a840-0e8d43d3061b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:47.104865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 71/135] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:46 2022] GET /identity/v3/projects/3d50dbac76b84572a22c3f79c86687da => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:47.111947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f178cb-55bc-469b-98f5-e8b0348343bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:47.112568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f178cb-55bc-469b-98f5-e8b0348343bb None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:47.112861 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f178cb-55bc-469b-98f5-e8b0348343bb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:47.113144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f178cb-55bc-469b-98f5-e8b0348343bb None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34/users/4a85c2f6540a47cfa927556bdcddaf95/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:47.115064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891d569-7b8e-4266-a840-0e8d43d3061b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:47.116659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f178cb-55bc-469b-98f5-e8b0348343bb None admin] RBAC: Authorizing `identity:create_grant(project_id=1a986d55348f4996bbf49674a39f2e34, user_id=4a85c2f6540a47cfa927556bdcddaf95, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:47.118148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f178cb-55bc-469b-98f5-e8b0348343bb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:47.192628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 65/136] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:16:46 2022] PUT /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34/users/4a85c2f6540a47cfa927556bdcddaf95/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:16:47.255967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891d569-7b8e-4266-a840-0e8d43d3061b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:47.297068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f0643-944c-4eca-9b63-146e6317369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:47.298085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0643-944c-4eca-9b63-146e6317369f None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:47.298383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0643-944c-4eca-9b63-146e6317369f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:47.298671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0643-944c-4eca-9b63-146e6317369f None admin] PATH_INFO: `/v3/projects/3d50dbac76b84572a22c3f79c86687da/users/7426c40478b347618984700782b5b8b6/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:47.307025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f0643-944c-4eca-9b63-146e6317369f None admin] RBAC: Authorizing `identity:create_grant(project_id=3d50dbac76b84572a22c3f79c86687da, user_id=7426c40478b347618984700782b5b8b6, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:47.308516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f0643-944c-4eca-9b63-146e6317369f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:47.373390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 72/137] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:16:47 2022] PUT /identity/v3/projects/3d50dbac76b84572a22c3f79c86687da/users/7426c40478b347618984700782b5b8b6/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:16:47.924033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc8c7a-5250-4cdc-b1fc-fdcd74574a60 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:47.924777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc8c7a-5250-4cdc-b1fc-fdcd74574a60 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:47.924777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc8c7a-5250-4cdc-b1fc-fdcd74574a60 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:47.926274 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 66/138] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:47.931802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e97c7-7e08-45ad-9b61-901c99dbff70 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:47.933117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e97c7-7e08-45ad-9b61-901c99dbff70 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:47.933117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e97c7-7e08-45ad-9b61-901c99dbff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:47.962531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3a2e97c7-7e08-45ad-9b61-901c99dbff70 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:47.964444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3a2e97c7-7e08-45ad-9b61-901c99dbff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:48.048380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 73/139] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:48.098182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc8c7a-5250-4cdc-b1fc-fdcd74574a60 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:48.217340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc8c7a-5250-4cdc-b1fc-fdcd74574a60 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:48.252988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb032f-b751-4a78-aee3-99933b9e87bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:48.253833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb032f-b751-4a78-aee3-99933b9e87bb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:48.254123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb032f-b751-4a78-aee3-99933b9e87bb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:48.254402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb032f-b751-4a78-aee3-99933b9e87bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:48.255625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb032f-b751-4a78-aee3-99933b9e87bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:48.257083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb032f-b751-4a78-aee3-99933b9e87bb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:48.258757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 67/140] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:48.270405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e97c7-7e08-45ad-9b61-901c99dbff70 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:48.387710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e97c7-7e08-45ad-9b61-901c99dbff70 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:48.439021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92943943-bc6b-42fd-830a-52f4572f6f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:48.440225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943943-bc6b-42fd-830a-52f4572f6f7c None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:48.440714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943943-bc6b-42fd-830a-52f4572f6f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:48.441197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943943-bc6b-42fd-830a-52f4572f6f7c None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:48.442520 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943943-bc6b-42fd-830a-52f4572f6f7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:48.445096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943943-bc6b-42fd-830a-52f4572f6f7c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:48.565228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 74/141] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:16:48 2022] POST /identity/v3/users => generated 283 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:16:49.129704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f8f5-fb43-4043-8d70-3f9eab99261f None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:49.130822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f8f5-fb43-4043-8d70-3f9eab99261f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:49.131338 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f8f5-fb43-4043-8d70-3f9eab99261f None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:49.133035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 68/142] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:49.144926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a1f5-4909-43c8-843f-9e6588051907 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:49.145924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a1f5-4909-43c8-843f-9e6588051907 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:49.146407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a1f5-4909-43c8-843f-9e6588051907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:49.170373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f834a1f5-4909-43c8-843f-9e6588051907 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:49.171922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f834a1f5-4909-43c8-843f-9e6588051907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:49.261042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 75/143] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:49.302576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1f8f5-fb43-4043-8d70-3f9eab99261f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:49.435209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1f8f5-fb43-4043-8d70-3f9eab99261f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:49.479535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb5bcb-6e19-41f7-b9eb-e62b80ac4ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:49.480872 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5bcb-6e19-41f7-b9eb-e62b80ac4ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:49.481444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5bcb-6e19-41f7-b9eb-e62b80ac4ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:49.481923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5bcb-6e19-41f7-b9eb-e62b80ac4ac3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:49.497070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb5bcb-6e19-41f7-b9eb-e62b80ac4ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-afcb5bcb-6e19-41f7-b9eb-e62b80ac4ac3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:49.505358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:49.506237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:16:49.506991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:49.513957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 69/144] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:49.519571 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a1f5-4909-43c8-843f-9e6588051907 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:49.543400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675f60d-8121-4858-9fea-a2ccc4252d5f None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:49.544022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675f60d-8121-4858-9fea-a2ccc4252d5f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:49.544540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675f60d-8121-4858-9fea-a2ccc4252d5f None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:49.546268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 70/145] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:16:49.553703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c550af-5d19-43cc-bec4-3a8507386001 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:49.554308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c550af-5d19-43cc-bec4-3a8507386001 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:49.554795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c550af-5d19-43cc-bec4-3a8507386001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:49.588214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-12c550af-5d19-43cc-bec4-3a8507386001 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:49.590009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-12c550af-5d19-43cc-bec4-3a8507386001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:49.687989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 71/146] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:49.709955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a1f5-4909-43c8-843f-9e6588051907 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:49.753553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a023e1-e39b-4f8d-b164-c04cf10f3471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:49.754609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a023e1-e39b-4f8d-b164-c04cf10f3471 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:49.755116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a023e1-e39b-4f8d-b164-c04cf10f3471 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:49.755591 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a023e1-e39b-4f8d-b164-c04cf10f3471 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:49.756557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a023e1-e39b-4f8d-b164-c04cf10f3471 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:49.757065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a023e1-e39b-4f8d-b164-c04cf10f3471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:49.758698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a023e1-e39b-4f8d-b164-c04cf10f3471 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:49.762314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c550af-5d19-43cc-bec4-3a8507386001 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:49.789813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 76/147] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:16:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:49.796031 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a023e1-e39b-4f8d-b164-c04cf10f3471 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:49.888536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c550af-5d19-43cc-bec4-3a8507386001 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:49.908091 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a023e1-e39b-4f8d-b164-c04cf10f3471 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:49.930414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4b016-c76b-40f3-91f0-948e1cde91b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:49.931656 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4b016-c76b-40f3-91f0-948e1cde91b2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:49.932161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4b016-c76b-40f3-91f0-948e1cde91b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:49.932639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4b016-c76b-40f3-91f0-948e1cde91b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:49.943769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4b016-c76b-40f3-91f0-948e1cde91b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:49.951321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a15f6-6b6a-4cd4-9b53-4ac539e06758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:49.952216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a15f6-6b6a-4cd4-9b53-4ac539e06758 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:49.952510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a15f6-6b6a-4cd4-9b53-4ac539e06758 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:49.952798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a15f6-6b6a-4cd4-9b53-4ac539e06758 None admin] PATH_INFO: `/v3/users/eab44cdae75b4a41b963f86a8fa0ec4d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-ebb4b016-c76b-40f3-91f0-948e1cde91b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:49.953784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:49.954591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:16:49.955372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:49.958013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 72/148] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:16:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:16:49.961854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a15f6-6b6a-4cd4-9b53-4ac539e06758 None admin] RBAC: Authorizing `identity:get_user(user_id=eab44cdae75b4a41b963f86a8fa0ec4d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:49.961854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a15f6-6b6a-4cd4-9b53-4ac539e06758 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:49.961854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 77/149] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:49 2022] GET /identity/v3/users/eab44cdae75b4a41b963f86a8fa0ec4d => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:49.965079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a15f6-6b6a-4cd4-9b53-4ac539e06758 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:49.967941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4b016-c76b-40f3-91f0-948e1cde91b2 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:50.076325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4b016-c76b-40f3-91f0-948e1cde91b2 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:50.100588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a15f6-6b6a-4cd4-9b53-4ac539e06758 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:50.113521 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca1dd1-c29e-443e-b36d-e722e65fa851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:50.114733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca1dd1-c29e-443e-b36d-e722e65fa851 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:50.115231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca1dd1-c29e-443e-b36d-e722e65fa851 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:50.115793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca1dd1-c29e-443e-b36d-e722e65fa851 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:50.117245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca1dd1-c29e-443e-b36d-e722e65fa851 None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:50.119162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca1dd1-c29e-443e-b36d-e722e65fa851 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:50.121819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 73/150] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:49 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:50.127428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca1dd1-c29e-443e-b36d-e722e65fa851 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:50.173545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6b194-a60b-4dda-ace6-6b3b97486c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:50.174943 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6b194-a60b-4dda-ace6-6b3b97486c17 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:50.175491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6b194-a60b-4dda-ace6-6b3b97486c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:50.175977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6b194-a60b-4dda-ace6-6b3b97486c17 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:50.177024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6b194-a60b-4dda-ace6-6b3b97486c17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:50.178130 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6b194-a60b-4dda-ace6-6b3b97486c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:50.184089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6b194-a60b-4dda-ace6-6b3b97486c17 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:50.203265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 78/151] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:16:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:50.226699 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6b194-a60b-4dda-ace6-6b3b97486c17 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:50.367454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca1dd1-c29e-443e-b36d-e722e65fa851 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:50.382027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6b194-a60b-4dda-ace6-6b3b97486c17 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:50.429695 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca3a75-b56f-455d-a706-b467d2ec26c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:50.430985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3a75-b56f-455d-a706-b467d2ec26c2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:50.431510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3a75-b56f-455d-a706-b467d2ec26c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:50.432034 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3a75-b56f-455d-a706-b467d2ec26c2 None admin] PATH_INFO: `/v3/users/7426c40478b347618984700782b5b8b6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:50.433881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca3a75-b56f-455d-a706-b467d2ec26c2 None admin] RBAC: Authorizing `identity:get_user(user_id=7426c40478b347618984700782b5b8b6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:50.435719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca3a75-b56f-455d-a706-b467d2ec26c2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:50.437661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 79/152] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:50 2022] GET /identity/v3/users/7426c40478b347618984700782b5b8b6 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:50.444182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca3a75-b56f-455d-a706-b467d2ec26c2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:50.479732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be0e6-0793-43cc-97b1-8d1c3eb74463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:50.480395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be0e6-0793-43cc-97b1-8d1c3eb74463 None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:50.480688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be0e6-0793-43cc-97b1-8d1c3eb74463 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:50.480971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be0e6-0793-43cc-97b1-8d1c3eb74463 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34/users/eab44cdae75b4a41b963f86a8fa0ec4d/roles/ef402940c145454090aa4eba58af85bf` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:50.486896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be0e6-0793-43cc-97b1-8d1c3eb74463 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a986d55348f4996bbf49674a39f2e34, user_id=eab44cdae75b4a41b963f86a8fa0ec4d, role_id=ef402940c145454090aa4eba58af85bf)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:50.488404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be0e6-0793-43cc-97b1-8d1c3eb74463 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:50.569218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca3a75-b56f-455d-a706-b467d2ec26c2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:50.575799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 74/153] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:16:50 2022] PUT /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34/users/eab44cdae75b4a41b963f86a8fa0ec4d/roles/ef402940c145454090aa4eba58af85bf => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:16:50.614723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ad08f-8b60-4ae5-a3ae-ef1524f0f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:50.615764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ad08f-8b60-4ae5-a3ae-ef1524f0f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:50.616249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ad08f-8b60-4ae5-a3ae-ef1524f0f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:50.616862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ad08f-8b60-4ae5-a3ae-ef1524f0f5d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:50.695218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ad08f-8b60-4ae5-a3ae-ef1524f0f5d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:50.697092 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ad08f-8b60-4ae5-a3ae-ef1524f0f5d0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:50.718005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1488d7a-72b5-423e-b3a2-2020e0d41500 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:50.718456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1488d7a-72b5-423e-b3a2-2020e0d41500 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:50.718853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1488d7a-72b5-423e-b3a2-2020e0d41500 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:50.720639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 75/154] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:50.726552 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64dd28-9c7d-485f-afe4-5f4761949446 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:50.726962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64dd28-9c7d-485f-afe4-5f4761949446 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:50.727349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64dd28-9c7d-485f-afe4-5f4761949446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:50.777386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-2c64dd28-9c7d-485f-afe4-5f4761949446 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:50.777386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2c64dd28-9c7d-485f-afe4-5f4761949446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:50.850128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 80/155] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:50.856494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ad08f-8b60-4ae5-a3ae-ef1524f0f5d0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:50.943618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 76/156] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:50.980440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64dd28-9c7d-485f-afe4-5f4761949446 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:51.107058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ad08f-8b60-4ae5-a3ae-ef1524f0f5d0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:51.178693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6dd40-8e68-4696-84fd-5b63c4655288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:51.179578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6dd40-8e68-4696-84fd-5b63c4655288 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:51.179863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6dd40-8e68-4696-84fd-5b63c4655288 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:51.180142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6dd40-8e68-4696-84fd-5b63c4655288 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:51.183239 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6dd40-8e68-4696-84fd-5b63c4655288 None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:51.184719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6dd40-8e68-4696-84fd-5b63c4655288 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:51.191617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 81/157] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:50 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:51.198984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6dd40-8e68-4696-84fd-5b63c4655288 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:51.206776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64dd28-9c7d-485f-afe4-5f4761949446 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:51.295532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa13127-65b9-4914-8bf5-720af3f10a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:51.296374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa13127-65b9-4914-8bf5-720af3f10a77 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:51.296667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa13127-65b9-4914-8bf5-720af3f10a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:51.296954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa13127-65b9-4914-8bf5-720af3f10a77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:51.319274 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa13127-65b9-4914-8bf5-720af3f10a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-2fa13127-65b9-4914-8bf5-720af3f10a77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:51.331388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:51.332539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:51.334091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 77/158] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:16:51.341171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa13127-65b9-4914-8bf5-720af3f10a77 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:51.376895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6dd40-8e68-4696-84fd-5b63c4655288 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:51.436311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffb4f-cd29-4d82-829f-1e9dbd573ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:51.437320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffb4f-cd29-4d82-829f-1e9dbd573ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:51.437749 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffb4f-cd29-4d82-829f-1e9dbd573ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:51.438182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ffb4f-cd29-4d82-829f-1e9dbd573ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:51.439538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ffb4f-cd29-4d82-829f-1e9dbd573ba1 None admin] RBAC: Adding query filter params (role.id=2f9013fc95d448a5b605f539fb6ae08f, scope.project.id=1a986d55348f4996bbf49674a39f2e34, user.id=7426c40478b347618984700782b5b8b6) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:51.440008 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ffb4f-cd29-4d82-829f-1e9dbd573ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:51.442404 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ffb4f-cd29-4d82-829f-1e9dbd573ba1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:51.456243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 82/159] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:51 2022] GET /identity/v3/role_assignments?user.id=7426c40478b347618984700782b5b8b6&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=2f9013fc95d448a5b605f539fb6ae08f => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:51.472177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa13127-65b9-4914-8bf5-720af3f10a77 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:51.516723 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0f16c-4cf6-4500-8ce4-44600c7cb88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:51.517457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0f16c-4cf6-4500-8ce4-44600c7cb88f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:51.517802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0f16c-4cf6-4500-8ce4-44600c7cb88f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:51.518023 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0f16c-4cf6-4500-8ce4-44600c7cb88f None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:51.518786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0f16c-4cf6-4500-8ce4-44600c7cb88f None admin] RBAC: Adding query filter params (name=member) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:51.519098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0f16c-4cf6-4500-8ce4-44600c7cb88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:51.520505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0f16c-4cf6-4500-8ce4-44600c7cb88f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:51.534357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 78/160] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:16:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:51.540194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffb4f-cd29-4d82-829f-1e9dbd573ba1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:51.712627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d11458-b46e-4084-92ea-28a0685e9c90 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:51.713606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d11458-b46e-4084-92ea-28a0685e9c90 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:51.713796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d11458-b46e-4084-92ea-28a0685e9c90 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:51.715488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 79/161] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:51.718245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ffb4f-cd29-4d82-829f-1e9dbd573ba1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:51.731152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a5c4-056d-4f43-8e27-ddae541ebcaa None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:51.731467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a5c4-056d-4f43-8e27-ddae541ebcaa None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:51.731716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a5c4-056d-4f43-8e27-ddae541ebcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:51.770549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-e098a5c4-056d-4f43-8e27-ddae541ebcaa None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:51.771967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e098a5c4-056d-4f43-8e27-ddae541ebcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:51.780347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17238f4b-ea3a-4202-802b-7300909bb9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:51.781733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17238f4b-ea3a-4202-802b-7300909bb9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:51.782172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17238f4b-ea3a-4202-802b-7300909bb9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:51.782583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17238f4b-ea3a-4202-802b-7300909bb9f7 None admin] PATH_INFO: `/v3/users/7426c40478b347618984700782b5b8b6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:51.786494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17238f4b-ea3a-4202-802b-7300909bb9f7 None admin] RBAC: Authorizing `identity:get_user(user_id=7426c40478b347618984700782b5b8b6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:51.788845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17238f4b-ea3a-4202-802b-7300909bb9f7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:51.792043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 83/162] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:51 2022] GET /identity/v3/users/7426c40478b347618984700782b5b8b6 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:51.793947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b18b3-8122-4e02-a6a5-c6fa21baa9e5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:51.794378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b18b3-8122-4e02-a6a5-c6fa21baa9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:51.794817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b18b3-8122-4e02-a6a5-c6fa21baa9e5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:51.796957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 84/163] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:51.802778 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b18b3-8122-4e02-a6a5-c6fa21baa9e5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:51.938993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 80/164] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:51.940135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca0c4-01f6-4488-93c7-03c5efd3a4e2 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:51.940427 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca0c4-01f6-4488-93c7-03c5efd3a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:51.940713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca0c4-01f6-4488-93c7-03c5efd3a4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:51.966398 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-866ca0c4-01f6-4488-93c7-03c5efd3a4e2 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:51.967521 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-866ca0c4-01f6-4488-93c7-03c5efd3a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:52.001213 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b18b3-8122-4e02-a6a5-c6fa21baa9e5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:52.066080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633087f4-cf76-409e-b529-739f1f1edec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:52.067819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633087f4-cf76-409e-b529-739f1f1edec2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:52.068312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633087f4-cf76-409e-b529-739f1f1edec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:52.068834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633087f4-cf76-409e-b529-739f1f1edec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:52.118376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 81/165] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:52.121337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ca0c4-01f6-4488-93c7-03c5efd3a4e2 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:52.238346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633087f4-cf76-409e-b529-739f1f1edec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:52.239831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633087f4-cf76-409e-b529-739f1f1edec2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:52.296853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ca0c4-01f6-4488-93c7-03c5efd3a4e2 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:52.344292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235c0ee-503f-4295-bc5d-0569a335906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:52.345581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c0ee-503f-4295-bc5d-0569a335906b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:52.346152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c0ee-503f-4295-bc5d-0569a335906b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:52.346671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235c0ee-503f-4295-bc5d-0569a335906b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:52.365435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235c0ee-503f-4295-bc5d-0569a335906b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-9235c0ee-503f-4295-bc5d-0569a335906b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:52.381727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:52.382784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:52.383977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 82/166] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:52.385144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235c0ee-503f-4295-bc5d-0569a335906b None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:52.446110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 85/167] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:52.448837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633087f4-cf76-409e-b529-739f1f1edec2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:52.504014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235c0ee-503f-4295-bc5d-0569a335906b None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:52.550036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab4c77-9c53-4f1b-b220-a0399e9284ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:52.550862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab4c77-9c53-4f1b-b220-a0399e9284ee None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:52.551156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab4c77-9c53-4f1b-b220-a0399e9284ee None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:52.551443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab4c77-9c53-4f1b-b220-a0399e9284ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:52.570726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab4c77-9c53-4f1b-b220-a0399e9284ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-d8ab4c77-9c53-4f1b-b220-a0399e9284ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:52.587378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:52.588915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 83/168] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:16:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:52.592111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab4c77-9c53-4f1b-b220-a0399e9284ee None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:52.707622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633087f4-cf76-409e-b529-739f1f1edec2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:52.770334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab4c77-9c53-4f1b-b220-a0399e9284ee None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:52.801496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144b59-2364-4a38-a0d7-ba7e49d12987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:52.802565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144b59-2364-4a38-a0d7-ba7e49d12987 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:52.803045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144b59-2364-4a38-a0d7-ba7e49d12987 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:52.803537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144b59-2364-4a38-a0d7-ba7e49d12987 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:52.804507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32144b59-2364-4a38-a0d7-ba7e49d12987 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:52.805011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32144b59-2364-4a38-a0d7-ba7e49d12987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:52.807170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32144b59-2364-4a38-a0d7-ba7e49d12987 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:52.827166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 86/169] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:16:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:52.828445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144b59-2364-4a38-a0d7-ba7e49d12987 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:52.833120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdcf1b-3d91-4858-9af9-d316154bbefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:52.834546 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdcf1b-3d91-4858-9af9-d316154bbefd None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:52.834989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdcf1b-3d91-4858-9af9-d316154bbefd None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:52.835405 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdcf1b-3d91-4858-9af9-d316154bbefd None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:52.838897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdcf1b-3d91-4858-9af9-d316154bbefd None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:52.840778 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdcf1b-3d91-4858-9af9-d316154bbefd None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:52.842751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 84/170] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:52 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:52.843945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdcf1b-3d91-4858-9af9-d316154bbefd None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:53.053978 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdcf1b-3d91-4858-9af9-d316154bbefd None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:53.089000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144b59-2364-4a38-a0d7-ba7e49d12987 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:53.118358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce814567-42e7-4158-b62b-7fc43360f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:53.120544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce814567-42e7-4158-b62b-7fc43360f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:53.121010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce814567-42e7-4158-b62b-7fc43360f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:53.121441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce814567-42e7-4158-b62b-7fc43360f5a7 None admin] PATH_INFO: `/v3/users/7426c40478b347618984700782b5b8b6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:53.127242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce814567-42e7-4158-b62b-7fc43360f5a7 None admin] RBAC: Authorizing `identity:get_user(user_id=7426c40478b347618984700782b5b8b6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:53.130149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce814567-42e7-4158-b62b-7fc43360f5a7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:53.132538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 85/171] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:52 2022] GET /identity/v3/users/7426c40478b347618984700782b5b8b6 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:53.137205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce814567-42e7-4158-b62b-7fc43360f5a7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:53.162205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05199389-26a2-4862-b366-1756087e5492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:53.163371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199389-26a2-4862-b366-1756087e5492 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:53.163859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199389-26a2-4862-b366-1756087e5492 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:53.164337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199389-26a2-4862-b366-1756087e5492 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:53.165350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05199389-26a2-4862-b366-1756087e5492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:53.166437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05199389-26a2-4862-b366-1756087e5492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:53.168168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05199389-26a2-4862-b366-1756087e5492 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:53.185504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 87/172] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:53.186846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05199389-26a2-4862-b366-1756087e5492 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:53.277042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce814567-42e7-4158-b62b-7fc43360f5a7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:53.315905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0122ec-2d0c-4b72-910b-e2462bc6e1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:53.317070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0122ec-2d0c-4b72-910b-e2462bc6e1bc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:53.319945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0122ec-2d0c-4b72-910b-e2462bc6e1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:53.320473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0122ec-2d0c-4b72-910b-e2462bc6e1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:53.321621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0122ec-2d0c-4b72-910b-e2462bc6e1bc None admin] RBAC: Adding query filter params (role.id=4982f0e43bc8430d81d3906431eff62e, scope.project.id=1a986d55348f4996bbf49674a39f2e34, user.id=7426c40478b347618984700782b5b8b6) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:53.323379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0122ec-2d0c-4b72-910b-e2462bc6e1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:53.325061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0122ec-2d0c-4b72-910b-e2462bc6e1bc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:53.335698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 86/173] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:53 2022] GET /identity/v3/role_assignments?user.id=7426c40478b347618984700782b5b8b6&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=4982f0e43bc8430d81d3906431eff62e => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:53.336601 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0122ec-2d0c-4b72-910b-e2462bc6e1bc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:53.393790 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05199389-26a2-4862-b366-1756087e5492 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:53.495721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5e880-311f-44e8-a8e3-b8b1d12a9e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:53.497642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5e880-311f-44e8-a8e3-b8b1d12a9e7d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:53.498171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5e880-311f-44e8-a8e3-b8b1d12a9e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:53.498699 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5e880-311f-44e8-a8e3-b8b1d12a9e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:53.658035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5e880-311f-44e8-a8e3-b8b1d12a9e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:53.659757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5e880-311f-44e8-a8e3-b8b1d12a9e7d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:53.668681 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0122ec-2d0c-4b72-910b-e2462bc6e1bc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:53.734630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04473d1-b994-4d5e-a654-83f0417e1882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:53.735526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04473d1-b994-4d5e-a654-83f0417e1882 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:53.735819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04473d1-b994-4d5e-a654-83f0417e1882 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:53.736099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04473d1-b994-4d5e-a654-83f0417e1882 None admin] PATH_INFO: `/v3/users/4a85c2f6540a47cfa927556bdcddaf95` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:53.742043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04473d1-b994-4d5e-a654-83f0417e1882 None admin] RBAC: Authorizing `identity:get_user(user_id=4a85c2f6540a47cfa927556bdcddaf95)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:53.743587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04473d1-b994-4d5e-a654-83f0417e1882 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:53.746011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 87/174] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:53 2022] GET /identity/v3/users/4a85c2f6540a47cfa927556bdcddaf95 => generated 247 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:53.751395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04473d1-b994-4d5e-a654-83f0417e1882 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:53.772006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 88/175] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:53.778434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5e880-311f-44e8-a8e3-b8b1d12a9e7d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:53.871035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04473d1-b994-4d5e-a654-83f0417e1882 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:53.920385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12d612-cef3-4a40-92da-d881dc6045a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:53.920385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12d612-cef3-4a40-92da-d881dc6045a6 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:53.920385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12d612-cef3-4a40-92da-d881dc6045a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:53.920385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12d612-cef3-4a40-92da-d881dc6045a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:53.921772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5e880-311f-44e8-a8e3-b8b1d12a9e7d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:53.964026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aa72e-3f1d-41b5-9b08-d0c7eea0c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:53.964917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aa72e-3f1d-41b5-9b08-d0c7eea0c393 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:53.965204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aa72e-3f1d-41b5-9b08-d0c7eea0c393 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:53.965513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aa72e-3f1d-41b5-9b08-d0c7eea0c393 None admin] PATH_INFO: `/v3/projects/3d50dbac76b84572a22c3f79c86687da` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:53.974266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566aa72e-3f1d-41b5-9b08-d0c7eea0c393 None admin] RBAC: Authorizing `identity:get_project(project_id=3d50dbac76b84572a22c3f79c86687da)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:53.974266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566aa72e-3f1d-41b5-9b08-d0c7eea0c393 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:53.974266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 89/176] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:53 2022] GET /identity/v3/projects/3d50dbac76b84572a22c3f79c86687da => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:53.979099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aa72e-3f1d-41b5-9b08-d0c7eea0c393 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:53.998562 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12d612-cef3-4a40-92da-d881dc6045a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:54.000213 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12d612-cef3-4a40-92da-d881dc6045a6 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:54.106241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 88/177] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 20:16:54.111834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aa72e-3f1d-41b5-9b08-d0c7eea0c393 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:54.111970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12d612-cef3-4a40-92da-d881dc6045a6 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:54.160125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979dc5e-d086-4303-9ed8-d0f21bc09ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:54.160806 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979dc5e-d086-4303-9ed8-d0f21bc09ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.161094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979dc5e-d086-4303-9ed8-d0f21bc09ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.161433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979dc5e-d086-4303-9ed8-d0f21bc09ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.162296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979dc5e-d086-4303-9ed8-d0f21bc09ec0 None admin] RBAC: Adding query filter params (role.id=4982f0e43bc8430d81d3906431eff62e, scope.project.id=3d50dbac76b84572a22c3f79c86687da, user.id=7426c40478b347618984700782b5b8b6) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:54.162617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979dc5e-d086-4303-9ed8-d0f21bc09ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:54.164075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979dc5e-d086-4303-9ed8-d0f21bc09ec0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:54.182964 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 90/178] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:53 2022] GET /identity/v3/role_assignments?user.id=7426c40478b347618984700782b5b8b6&scope.project.id=3d50dbac76b84572a22c3f79c86687da&role.id=4982f0e43bc8430d81d3906431eff62e => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:54.259801 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12d612-cef3-4a40-92da-d881dc6045a6 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:54.308532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17347a21-0e25-419c-a34a-46405abb24c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:54.309849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17347a21-0e25-419c-a34a-46405abb24c2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.310363 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17347a21-0e25-419c-a34a-46405abb24c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.310849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17347a21-0e25-419c-a34a-46405abb24c2 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.312283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17347a21-0e25-419c-a34a-46405abb24c2 None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:54.313966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17347a21-0e25-419c-a34a-46405abb24c2 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:54.315982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 89/179] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:54 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:54.322472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979dc5e-d086-4303-9ed8-d0f21bc09ec0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:54.414062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d9458-b4b0-44f8-8911-782e6ac05e00 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.414727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d9458-b4b0-44f8-8911-782e6ac05e00 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.415205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d9458-b4b0-44f8-8911-782e6ac05e00 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.416992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 90/180] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:54.427216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e54cfc-f903-4a48-90c6-2a841fe146af None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.427835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e54cfc-f903-4a48-90c6-2a841fe146af None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.428311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e54cfc-f903-4a48-90c6-2a841fe146af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.452426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979dc5e-d086-4303-9ed8-d0f21bc09ec0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:54.463638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-80e54cfc-f903-4a48-90c6-2a841fe146af None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:54.465399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-80e54cfc-f903-4a48-90c6-2a841fe146af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:54.500876 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a78f7-81e9-42d0-970b-63bc6b81279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:54.503592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a78f7-81e9-42d0-970b-63bc6b81279c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.505740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a78f7-81e9-42d0-970b-63bc6b81279c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.506311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a78f7-81e9-42d0-970b-63bc6b81279c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.507455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a78f7-81e9-42d0-970b-63bc6b81279c None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=1a986d55348f4996bbf49674a39f2e34, user.id=4a85c2f6540a47cfa927556bdcddaf95) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:54.510124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a78f7-81e9-42d0-970b-63bc6b81279c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:54.514208 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a78f7-81e9-42d0-970b-63bc6b81279c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:54.524985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 91/181] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:54 2022] GET /identity/v3/role_assignments?user.id=4a85c2f6540a47cfa927556bdcddaf95&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=4ae0665802b946be870ab06274297a1d => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:54.573705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 91/182] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:54.601142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a78f7-81e9-42d0-970b-63bc6b81279c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:54.725934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a78f7-81e9-42d0-970b-63bc6b81279c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:54.731298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96dac-27ff-402e-aa3e-d504eeed8ffc None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.731800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96dac-27ff-402e-aa3e-d504eeed8ffc None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.731899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96dac-27ff-402e-aa3e-d504eeed8ffc None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.737662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 92/183] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:16:54.739927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3e70-70d6-42f1-b1b2-c4df76f5eb4b None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.740222 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3e70-70d6-42f1-b1b2-c4df76f5eb4b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.740505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3e70-70d6-42f1-b1b2-c4df76f5eb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.766318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-593a3e70-70d6-42f1-b1b2-c4df76f5eb4b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:54.768739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-593a3e70-70d6-42f1-b1b2-c4df76f5eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:54.788323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b00bfa-b54a-4ad0-9457-1553c7bed22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:54.789315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00bfa-b54a-4ad0-9457-1553c7bed22f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.789445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00bfa-b54a-4ad0-9457-1553c7bed22f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.789726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b00bfa-b54a-4ad0-9457-1553c7bed22f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.804974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b00bfa-b54a-4ad0-9457-1553c7bed22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-17b00bfa-b54a-4ad0-9457-1553c7bed22f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:54.815549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:54.816459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:16:54.817221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 92/184] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:54.820099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a9b04-9ae1-4186-aa5a-253fecf5fe95 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.820099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a9b04-9ae1-4186-aa5a-253fecf5fe95 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.820099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a9b04-9ae1-4186-aa5a-253fecf5fe95 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.820099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 93/185] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:54.822986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56c9f8-af3d-410b-9a91-738d98a188eb None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.822986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56c9f8-af3d-410b-9a91-738d98a188eb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.822986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56c9f8-af3d-410b-9a91-738d98a188eb None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.824646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 94/186] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:54.825461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56c9f8-af3d-410b-9a91-738d98a188eb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:54.851402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 93/187] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:54.852552 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68d415-61ec-4ff3-8220-c1ccc132ffee None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.852857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68d415-61ec-4ff3-8220-c1ccc132ffee None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.853141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68d415-61ec-4ff3-8220-c1ccc132ffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.878472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-af68d415-61ec-4ff3-8220-c1ccc132ffee None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:54.879673 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-af68d415-61ec-4ff3-8220-c1ccc132ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:54.948359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56c9f8-af3d-410b-9a91-738d98a188eb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:54.948982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 94/188] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:54.951110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b335e-6a31-4a0e-8134-0453cc417712 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.951110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b335e-6a31-4a0e-8134-0453cc417712 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.951110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b335e-6a31-4a0e-8134-0453cc417712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.967127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-509b335e-6a31-4a0e-8134-0453cc417712 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:54.968383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-509b335e-6a31-4a0e-8134-0453cc417712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:54.983354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b1579-f962-4830-a5e7-e02d8a0f6f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:54.983959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b1579-f962-4830-a5e7-e02d8a0f6f27 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:54.984241 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b1579-f962-4830-a5e7-e02d8a0f6f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:54.984517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b1579-f962-4830-a5e7-e02d8a0f6f27 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:54.985260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b1579-f962-4830-a5e7-e02d8a0f6f27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:54.985593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b1579-f962-4830-a5e7-e02d8a0f6f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:54.986955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b1579-f962-4830-a5e7-e02d8a0f6f27 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:54.995668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 95/189] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:54.996434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b1579-f962-4830-a5e7-e02d8a0f6f27 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.034618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 95/190] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:55.036587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b335e-6a31-4a0e-8134-0453cc417712 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.091671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b1579-f962-4830-a5e7-e02d8a0f6f27 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:55.124392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4047b33-b53d-4445-b14c-09e093c67fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:55.125397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4047b33-b53d-4445-b14c-09e093c67fcd None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:55.125764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4047b33-b53d-4445-b14c-09e093c67fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:55.126140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4047b33-b53d-4445-b14c-09e093c67fcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:55.130991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b335e-6a31-4a0e-8134-0453cc417712 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:55.136415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4047b33-b53d-4445-b14c-09e093c67fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f4047b33-b53d-4445-b14c-09e093c67fcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:55.144318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:55.145420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 96/191] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:16:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:55.146321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4047b33-b53d-4445-b14c-09e093c67fcd None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.165443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01989-6567-4360-8d69-36ce7524f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:55.166968 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01989-6567-4360-8d69-36ce7524f2ab None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:55.167400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01989-6567-4360-8d69-36ce7524f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:55.167692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01989-6567-4360-8d69-36ce7524f2ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:55.177292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c01989-6567-4360-8d69-36ce7524f2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-67c01989-6567-4360-8d69-36ce7524f2ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:55.185614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:55.187357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 96/192] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:55.188943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01989-6567-4360-8d69-36ce7524f2ab None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.250584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4047b33-b53d-4445-b14c-09e093c67fcd None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:55.281611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e211f-7763-4e9b-9172-6d99e8d72146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:55.282486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e211f-7763-4e9b-9172-6d99e8d72146 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:55.282769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e211f-7763-4e9b-9172-6d99e8d72146 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:55.283045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e211f-7763-4e9b-9172-6d99e8d72146 None admin] PATH_INFO: `/v3/users/cdd6037917cc40ec98db3ee5284c7718` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:55.285682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01989-6567-4360-8d69-36ce7524f2ab None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:55.296183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e211f-7763-4e9b-9172-6d99e8d72146 None admin] RBAC: Authorizing `identity:get_user(user_id=cdd6037917cc40ec98db3ee5284c7718)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:55.297685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e211f-7763-4e9b-9172-6d99e8d72146 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:55.300043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 97/193] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:55 2022] GET /identity/v3/users/cdd6037917cc40ec98db3ee5284c7718 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:55.300154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e211f-7763-4e9b-9172-6d99e8d72146 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.318848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1c933-dd82-4e6a-8c09-3a2499132fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:55.319642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1c933-dd82-4e6a-8c09-3a2499132fad None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:55.319933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1c933-dd82-4e6a-8c09-3a2499132fad None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:55.320210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1c933-dd82-4e6a-8c09-3a2499132fad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:55.321467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1c933-dd82-4e6a-8c09-3a2499132fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:55.323055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1c933-dd82-4e6a-8c09-3a2499132fad None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:55.324660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 97/194] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:55.326150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1c933-dd82-4e6a-8c09-3a2499132fad None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.392763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e211f-7763-4e9b-9172-6d99e8d72146 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:55.419277 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1c933-dd82-4e6a-8c09-3a2499132fad None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:55.424533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c499f-c6a6-49c7-b154-0c40c38b51d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:55.425197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c499f-c6a6-49c7-b154-0c40c38b51d3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:55.425509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c499f-c6a6-49c7-b154-0c40c38b51d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:55.425787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c499f-c6a6-49c7-b154-0c40c38b51d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:55.426533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c499f-c6a6-49c7-b154-0c40c38b51d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:55.426837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c499f-c6a6-49c7-b154-0c40c38b51d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:55.428192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c499f-c6a6-49c7-b154-0c40c38b51d3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:55.436545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 98/195] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:16:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:55.441221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c499f-c6a6-49c7-b154-0c40c38b51d3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.451265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589e146-bf8f-4699-b789-28b5b3ba3796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:55.451943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589e146-bf8f-4699-b789-28b5b3ba3796 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:55.452230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589e146-bf8f-4699-b789-28b5b3ba3796 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:55.452519 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589e146-bf8f-4699-b789-28b5b3ba3796 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:55.453284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589e146-bf8f-4699-b789-28b5b3ba3796 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:55.453605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589e146-bf8f-4699-b789-28b5b3ba3796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:55.454975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589e146-bf8f-4699-b789-28b5b3ba3796 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:55.463750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 98/196] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:16:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:55.464446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589e146-bf8f-4699-b789-28b5b3ba3796 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.534910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c499f-c6a6-49c7-b154-0c40c38b51d3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:55.561729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589e146-bf8f-4699-b789-28b5b3ba3796 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:55.568037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a633ade-652c-4664-8059-6c060d611012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:55.568704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a633ade-652c-4664-8059-6c060d611012 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:55.568993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a633ade-652c-4664-8059-6c060d611012 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:55.569287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a633ade-652c-4664-8059-6c060d611012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:55.594177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c7872-ec55-4555-810d-b62fe05da530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:55.594851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7872-ec55-4555-810d-b62fe05da530 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:55.595139 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7872-ec55-4555-810d-b62fe05da530 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:55.595420 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7872-ec55-4555-810d-b62fe05da530 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:55.596133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c7872-ec55-4555-810d-b62fe05da530 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:55.597611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c7872-ec55-4555-810d-b62fe05da530 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:55.633781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a633ade-652c-4664-8059-6c060d611012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:55.636550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a633ade-652c-4664-8059-6c060d611012 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:55.698898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 99/197] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:16:55 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:16:55.699800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c7872-ec55-4555-810d-b62fe05da530 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.737590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 99/198] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:55.738475 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a633ade-652c-4664-8059-6c060d611012 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.837171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c7872-ec55-4555-810d-b62fe05da530 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:55.844779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a633ade-652c-4664-8059-6c060d611012 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:55.876685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65684118-886b-42a7-896b-7fb83d7b023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:55.877590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684118-886b-42a7-896b-7fb83d7b023a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:55.877878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684118-886b-42a7-896b-7fb83d7b023a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:55.878156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684118-886b-42a7-896b-7fb83d7b023a None admin] PATH_INFO: `/v3/users/cdd6037917cc40ec98db3ee5284c7718` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:55.879362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65684118-886b-42a7-896b-7fb83d7b023a None admin] RBAC: Authorizing `identity:get_user(user_id=cdd6037917cc40ec98db3ee5284c7718)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:55.880827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65684118-886b-42a7-896b-7fb83d7b023a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:55.882644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 100/199] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:55 2022] GET /identity/v3/users/cdd6037917cc40ec98db3ee5284c7718 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:55.883542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65684118-886b-42a7-896b-7fb83d7b023a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:55.883775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465b178-d7bb-411f-a7fb-72a7072c7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:55.884706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b178-d7bb-411f-a7fb-72a7072c7d1f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:55.885147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b178-d7bb-411f-a7fb-72a7072c7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:55.885682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465b178-d7bb-411f-a7fb-72a7072c7d1f None admin] PATH_INFO: `/v3/users/eab44cdae75b4a41b963f86a8fa0ec4d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:55.887948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465b178-d7bb-411f-a7fb-72a7072c7d1f None admin] RBAC: Authorizing `identity:get_user(user_id=eab44cdae75b4a41b963f86a8fa0ec4d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:55.889439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465b178-d7bb-411f-a7fb-72a7072c7d1f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:55.891204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 100/200] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:55 2022] GET /identity/v3/users/eab44cdae75b4a41b963f86a8fa0ec4d => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:55.895590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465b178-d7bb-411f-a7fb-72a7072c7d1f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:56.001439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65684118-886b-42a7-896b-7fb83d7b023a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:56.013807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465b178-d7bb-411f-a7fb-72a7072c7d1f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:56.092313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5fa07-7b3b-4886-8d8e-ba5f4594c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:56.093365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5fa07-7b3b-4886-8d8e-ba5f4594c8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:56.093945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5fa07-7b3b-4886-8d8e-ba5f4594c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:56.094451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5fa07-7b3b-4886-8d8e-ba5f4594c8b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:56.095942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ae98f-21c4-4fe7-b437-39e9e351c07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:56.097023 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae98f-21c4-4fe7-b437-39e9e351c07a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:56.097417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae98f-21c4-4fe7-b437-39e9e351c07a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:56.097708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae98f-21c4-4fe7-b437-39e9e351c07a None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:56.098961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ae98f-21c4-4fe7-b437-39e9e351c07a None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:56.100441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ae98f-21c4-4fe7-b437-39e9e351c07a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:56.102372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 101/201] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:55 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:56.102985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ae98f-21c4-4fe7-b437-39e9e351c07a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:56.176103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5fa07-7b3b-4886-8d8e-ba5f4594c8b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:56.177646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5fa07-7b3b-4886-8d8e-ba5f4594c8b6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:56.211179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ae98f-21c4-4fe7-b437-39e9e351c07a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:56.247906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032166d-e206-4af2-a15b-fd52d9b683cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:56.248578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032166d-e206-4af2-a15b-fd52d9b683cc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:56.248869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032166d-e206-4af2-a15b-fd52d9b683cc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:56.249149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032166d-e206-4af2-a15b-fd52d9b683cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:56.293697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 101/202] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:56.295259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5fa07-7b3b-4886-8d8e-ba5f4594c8b6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:56.335364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032166d-e206-4af2-a15b-fd52d9b683cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:56.338586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032166d-e206-4af2-a15b-fd52d9b683cc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:56.409913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5fa07-7b3b-4886-8d8e-ba5f4594c8b6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:56.447845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7b077-3c25-4067-84fe-7adf3c9244fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:56.448975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7b077-3c25-4067-84fe-7adf3c9244fa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:56.449494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7b077-3c25-4067-84fe-7adf3c9244fa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:56.449977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7b077-3c25-4067-84fe-7adf3c9244fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:56.451043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7b077-3c25-4067-84fe-7adf3c9244fa None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598, user.id=cdd6037917cc40ec98db3ee5284c7718) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:56.451593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7b077-3c25-4067-84fe-7adf3c9244fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:56.453303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7b077-3c25-4067-84fe-7adf3c9244fa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:56.458765 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 102/203] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:56.458765 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032166d-e206-4af2-a15b-fd52d9b683cc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:56.464725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 102/204] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:56 2022] GET /identity/v3/role_assignments?user.id=cdd6037917cc40ec98db3ee5284c7718&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=4ae0665802b946be870ab06274297a1d => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:56.473311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7b077-3c25-4067-84fe-7adf3c9244fa None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:56.577332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032166d-e206-4af2-a15b-fd52d9b683cc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:56.615606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7269e1-cde0-48b1-8064-7cdb05fd0929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:56.616396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7269e1-cde0-48b1-8064-7cdb05fd0929 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:56.616687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7269e1-cde0-48b1-8064-7cdb05fd0929 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:56.616967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7269e1-cde0-48b1-8064-7cdb05fd0929 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:56.618311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7269e1-cde0-48b1-8064-7cdb05fd0929 None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:56.620310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7269e1-cde0-48b1-8064-7cdb05fd0929 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:56.622231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 103/205] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:56 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:56.628369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7269e1-cde0-48b1-8064-7cdb05fd0929 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:56.681002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7b077-3c25-4067-84fe-7adf3c9244fa None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:56.720108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429f6d4-5d52-483b-90db-5bd4b555332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:56.721239 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429f6d4-5d52-483b-90db-5bd4b555332f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:56.721551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429f6d4-5d52-483b-90db-5bd4b555332f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:56.721827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429f6d4-5d52-483b-90db-5bd4b555332f None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:56.730439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429f6d4-5d52-483b-90db-5bd4b555332f None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:56.731975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429f6d4-5d52-483b-90db-5bd4b555332f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:56.737259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 103/206] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:56 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:56.742636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429f6d4-5d52-483b-90db-5bd4b555332f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:56.789301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7269e1-cde0-48b1-8064-7cdb05fd0929 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:56.820121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de53d2-a652-4e87-a4c9-1461a40fb0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:56.820906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de53d2-a652-4e87-a4c9-1461a40fb0ca None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:56.821086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de53d2-a652-4e87-a4c9-1461a40fb0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:56.821351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de53d2-a652-4e87-a4c9-1461a40fb0ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:56.822955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de53d2-a652-4e87-a4c9-1461a40fb0ca None admin] RBAC: Adding query filter params (role.id=2f9013fc95d448a5b605f539fb6ae08f, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598, user.id=cdd6037917cc40ec98db3ee5284c7718) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:56.823408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de53d2-a652-4e87-a4c9-1461a40fb0ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:56.824864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de53d2-a652-4e87-a4c9-1461a40fb0ca None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:56.830680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 104/207] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:56 2022] GET /identity/v3/role_assignments?user.id=cdd6037917cc40ec98db3ee5284c7718&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=2f9013fc95d448a5b605f539fb6ae08f => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:56.878338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429f6d4-5d52-483b-90db-5bd4b555332f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:56.916931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a7db2-2233-47ef-a3a4-4a10d2a09c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:56.918024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7db2-2233-47ef-a3a4-4a10d2a09c69 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:56.918517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7db2-2233-47ef-a3a4-4a10d2a09c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:56.919018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7db2-2233-47ef-a3a4-4a10d2a09c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:56.920128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a7db2-2233-47ef-a3a4-4a10d2a09c69 None admin] RBAC: Adding query filter params (role.id=ef402940c145454090aa4eba58af85bf, scope.project.id=1a986d55348f4996bbf49674a39f2e34, user.id=eab44cdae75b4a41b963f86a8fa0ec4d) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:56.920658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a7db2-2233-47ef-a3a4-4a10d2a09c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:56.922382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a7db2-2233-47ef-a3a4-4a10d2a09c69 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:56.929791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 104/208] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:56 2022] GET /identity/v3/role_assignments?user.id=eab44cdae75b4a41b963f86a8fa0ec4d&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=ef402940c145454090aa4eba58af85bf => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:58.274073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffe493-cf5e-4ef1-bfb6-b7c22dd9b7eb None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:58.274560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffe493-cf5e-4ef1-bfb6-b7c22dd9b7eb None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:58.274560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffe493-cf5e-4ef1-bfb6-b7c22dd9b7eb None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:58.276626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 105/209] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:58.281813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d1c89-8493-4b66-870e-376c11e1a697 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:58.282211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d1c89-8493-4b66-870e-376c11e1a697 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:58.282380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d1c89-8493-4b66-870e-376c11e1a697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:58.299462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-630d1c89-8493-4b66-870e-376c11e1a697 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:58.300672 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-630d1c89-8493-4b66-870e-376c11e1a697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:58.330726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae9167-b957-42ed-b58a-aa04eaed7d60 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:58.331012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae9167-b957-42ed-b58a-aa04eaed7d60 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:58.331382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae9167-b957-42ed-b58a-aa04eaed7d60 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:58.333133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 106/210] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:16:58.338706 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218cd6f-8668-4718-b1a9-af6eb8344b55 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:58.338999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218cd6f-8668-4718-b1a9-af6eb8344b55 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:58.339287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218cd6f-8668-4718-b1a9-af6eb8344b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:58.356649 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d218cd6f-8668-4718-b1a9-af6eb8344b55 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:58.358046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d218cd6f-8668-4718-b1a9-af6eb8344b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:58.375458 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 105/211] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:58.405693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d1c89-8493-4b66-870e-376c11e1a697 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:58.438600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 107/212] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:16:58.467315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218cd6f-8668-4718-b1a9-af6eb8344b55 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:58.523503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d1c89-8493-4b66-870e-376c11e1a697 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:58.571298 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7cbc8-2d42-4592-a32e-eb84224bb6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:58.572092 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7cbc8-2d42-4592-a32e-eb84224bb6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:58.572387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7cbc8-2d42-4592-a32e-eb84224bb6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:58.572670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7cbc8-2d42-4592-a32e-eb84224bb6b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:58.573426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218cd6f-8668-4718-b1a9-af6eb8344b55 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:58.573942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7cbc8-2d42-4592-a32e-eb84224bb6b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:58.575619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7cbc8-2d42-4592-a32e-eb84224bb6b1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:58.583680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 106/213] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:16:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:16:58.584656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7cbc8-2d42-4592-a32e-eb84224bb6b1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:58.612905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155f738-3057-45df-96c1-b8f4c0cb8bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:58.613899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155f738-3057-45df-96c1-b8f4c0cb8bbd None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:58.614252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155f738-3057-45df-96c1-b8f4c0cb8bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:58.614599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155f738-3057-45df-96c1-b8f4c0cb8bbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:58.634830 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155f738-3057-45df-96c1-b8f4c0cb8bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-2155f738-3057-45df-96c1-b8f4c0cb8bbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:58.645302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:58.647479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:58.648949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 108/214] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:58.653362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155f738-3057-45df-96c1-b8f4c0cb8bbd None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:58.700340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7cbc8-2d42-4592-a32e-eb84224bb6b1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:58.736356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d061238-2f33-481a-827c-c6cb1e4df81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:58.737189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d061238-2f33-481a-827c-c6cb1e4df81a None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:58.737513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d061238-2f33-481a-827c-c6cb1e4df81a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:58.737822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d061238-2f33-481a-827c-c6cb1e4df81a None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:58.738616 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d061238-2f33-481a-827c-c6cb1e4df81a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:58.740182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d061238-2f33-481a-827c-c6cb1e4df81a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:58.761164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155f738-3057-45df-96c1-b8f4c0cb8bbd None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:58.799020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5605440-3385-49f3-b601-34a33fc6182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:58.799707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5605440-3385-49f3-b601-34a33fc6182d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:58.800002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5605440-3385-49f3-b601-34a33fc6182d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:58.800293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5605440-3385-49f3-b601-34a33fc6182d None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:58.801061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5605440-3385-49f3-b601-34a33fc6182d None admin] RBAC: Adding query filter params (name=member) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:58.801406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5605440-3385-49f3-b601-34a33fc6182d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:58.802821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5605440-3385-49f3-b601-34a33fc6182d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:58.817152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 109/215] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:16:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:58.819559 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5605440-3385-49f3-b601-34a33fc6182d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:58.829107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 107/216] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:16:58 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:16:58.963794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5605440-3385-49f3-b601-34a33fc6182d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:59.004409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c7291-0f80-4eea-91ee-904e937b33c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:59.005366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c7291-0f80-4eea-91ee-904e937b33c3 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:59.005629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c7291-0f80-4eea-91ee-904e937b33c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:59.005910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c7291-0f80-4eea-91ee-904e937b33c3 None admin] PATH_INFO: `/v3/users/600a3b603a0146b2bf55dfbcd8f2a370` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:59.022523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c7291-0f80-4eea-91ee-904e937b33c3 None admin] RBAC: Authorizing `identity:get_user(user_id=600a3b603a0146b2bf55dfbcd8f2a370)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:59.024024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c7291-0f80-4eea-91ee-904e937b33c3 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:59.026200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 110/217] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:16:58 2022] GET /identity/v3/users/600a3b603a0146b2bf55dfbcd8f2a370 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:59.033001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d061238-2f33-481a-827c-c6cb1e4df81a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:59.148383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d061238-2f33-481a-827c-c6cb1e4df81a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:59.152961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8818b-d603-4791-9a98-e5ca17e1fde8 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:59.153250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8818b-d603-4791-9a98-e5ca17e1fde8 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:59.153566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8818b-d603-4791-9a98-e5ca17e1fde8 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:59.155260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 111/218] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:59.160920 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534bbb-ff6e-4ffc-98f3-4c6c0b2d7de0 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:59.161209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534bbb-ff6e-4ffc-98f3-4c6c0b2d7de0 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:59.164254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534bbb-ff6e-4ffc-98f3-4c6c0b2d7de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:59.190031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-ce534bbb-ff6e-4ffc-98f3-4c6c0b2d7de0 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:59.191245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ce534bbb-ff6e-4ffc-98f3-4c6c0b2d7de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:59.194956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c994bbd-aee6-4d3c-add5-038b8086e600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:59.195651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994bbd-aee6-4d3c-add5-038b8086e600 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:59.195926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994bbd-aee6-4d3c-add5-038b8086e600 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:59.196206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994bbd-aee6-4d3c-add5-038b8086e600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:59.280384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 112/219] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:59.281794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c482ee-09ab-4b2b-8273-40558a8bbeaa None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:59.282078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c482ee-09ab-4b2b-8273-40558a8bbeaa None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:59.282361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c482ee-09ab-4b2b-8273-40558a8bbeaa None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:59.283667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 113/220] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:16:59.286123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c994bbd-aee6-4d3c-add5-038b8086e600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:59.287599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c994bbd-aee6-4d3c-add5-038b8086e600 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:59.289304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b92b7-f0f1-4bc7-8e20-5f0055facbc3 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:59.289624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b92b7-f0f1-4bc7-8e20-5f0055facbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:59.289911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b92b7-f0f1-4bc7-8e20-5f0055facbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:59.362140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-0f3b92b7-f0f1-4bc7-8e20-5f0055facbc3 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:16:59.364029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0f3b92b7-f0f1-4bc7-8e20-5f0055facbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:16:59.449454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 114/221] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:16:59.450288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b92b7-f0f1-4bc7-8e20-5f0055facbc3 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:59.483295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 108/222] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:16:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:16:59.484160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c994bbd-aee6-4d3c-add5-038b8086e600 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:59.591651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c994bbd-aee6-4d3c-add5-038b8086e600 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:59.597357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b92b7-f0f1-4bc7-8e20-5f0055facbc3 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:59.631368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ca211-c74a-46f5-9b05-0987d5405184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:59.632197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ca211-c74a-46f5-9b05-0987d5405184 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:59.632481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ca211-c74a-46f5-9b05-0987d5405184 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:59.632762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ca211-c74a-46f5-9b05-0987d5405184 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:59.640008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f54c7-db12-41a7-90fd-6a076bd0f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:59.640988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f54c7-db12-41a7-90fd-6a076bd0f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:59.641295 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f54c7-db12-41a7-90fd-6a076bd0f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:59.641903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f54c7-db12-41a7-90fd-6a076bd0f8e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:59.644756 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ca211-c74a-46f5-9b05-0987d5405184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:59.653468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f54c7-db12-41a7-90fd-6a076bd0f8e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5e2ca211-c74a-46f5-9b05-0987d5405184 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:59.655180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:59.656952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:16:59.658797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 109/223] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:16:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:59.660248 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ca211-c74a-46f5-9b05-0987d5405184 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-eb3f54c7-db12-41a7-90fd-6a076bd0f8e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:16:59.661990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:16:59.663444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 115/224] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:16:59.670091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f54c7-db12-41a7-90fd-6a076bd0f8e1 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:59.781250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f54c7-db12-41a7-90fd-6a076bd0f8e1 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:59.792408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ca211-c74a-46f5-9b05-0987d5405184 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:59.824472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8356656-351d-42a3-96dc-94f7cdc8a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:59.825496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8356656-351d-42a3-96dc-94f7cdc8a292 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:59.826181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8356656-351d-42a3-96dc-94f7cdc8a292 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:59.826584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8356656-351d-42a3-96dc-94f7cdc8a292 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:59.827746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8356656-351d-42a3-96dc-94f7cdc8a292 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:16:59.828156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8356656-351d-42a3-96dc-94f7cdc8a292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:59.830040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8356656-351d-42a3-96dc-94f7cdc8a292 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:59.831058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef761b-892d-4186-9ccf-c1fd5ce051cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:16:59.832035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef761b-892d-4186-9ccf-c1fd5ce051cf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:16:59.832424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef761b-892d-4186-9ccf-c1fd5ce051cf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:16:59.832804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef761b-892d-4186-9ccf-c1fd5ce051cf None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:16:59.834210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef761b-892d-4186-9ccf-c1fd5ce051cf None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:16:59.835870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef761b-892d-4186-9ccf-c1fd5ce051cf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:16:59.838488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 110/225] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:16:59 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:59.839738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 116/226] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:16:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:16:59.844405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef761b-892d-4186-9ccf-c1fd5ce051cf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:59.844548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8356656-351d-42a3-96dc-94f7cdc8a292 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:16:59.967338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef761b-892d-4186-9ccf-c1fd5ce051cf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:16:59.974655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8356656-351d-42a3-96dc-94f7cdc8a292 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:00.003839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fc0af-2ea0-45ed-ad32-d75013047929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:00.005379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fc0af-2ea0-45ed-ad32-d75013047929 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:00.005882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fc0af-2ea0-45ed-ad32-d75013047929 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:00.006361 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fc0af-2ea0-45ed-ad32-d75013047929 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:00.007366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fc0af-2ea0-45ed-ad32-d75013047929 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:00.007890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fc0af-2ea0-45ed-ad32-d75013047929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:00.009708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fc0af-2ea0-45ed-ad32-d75013047929 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:00.016818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd1cfb-91a1-430c-8f16-9232fc4b71b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:00.017540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd1cfb-91a1-430c-8f16-9232fc4b71b9 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:00.018070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd1cfb-91a1-430c-8f16-9232fc4b71b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:00.018359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd1cfb-91a1-430c-8f16-9232fc4b71b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:00.019209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd1cfb-91a1-430c-8f16-9232fc4b71b9 None admin] RBAC: Adding query filter params (role.id=4982f0e43bc8430d81d3906431eff62e, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598, user.id=600a3b603a0146b2bf55dfbcd8f2a370) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:00.019527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd1cfb-91a1-430c-8f16-9232fc4b71b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:00.020683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 111/227] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:16:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:00.020994 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd1cfb-91a1-430c-8f16-9232fc4b71b9 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:00.022041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fc0af-2ea0-45ed-ad32-d75013047929 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:00.029125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 117/228] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:16:59 2022] GET /identity/v3/role_assignments?user.id=600a3b603a0146b2bf55dfbcd8f2a370&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=4982f0e43bc8430d81d3906431eff62e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:00.034440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd1cfb-91a1-430c-8f16-9232fc4b71b9 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:00.157263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd1cfb-91a1-430c-8f16-9232fc4b71b9 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:00.200444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610e57-ad19-4ba4-b483-cab905fffbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:00.201397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610e57-ad19-4ba4-b483-cab905fffbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:00.201872 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610e57-ad19-4ba4-b483-cab905fffbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:00.202567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610e57-ad19-4ba4-b483-cab905fffbe7 None admin] PATH_INFO: `/v3/users/cdd6037917cc40ec98db3ee5284c7718` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:00.203868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02610e57-ad19-4ba4-b483-cab905fffbe7 None admin] RBAC: Authorizing `identity:get_user(user_id=cdd6037917cc40ec98db3ee5284c7718)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:00.205366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02610e57-ad19-4ba4-b483-cab905fffbe7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:00.207672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 118/229] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:00 2022] GET /identity/v3/users/cdd6037917cc40ec98db3ee5284c7718 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:00.214251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610e57-ad19-4ba4-b483-cab905fffbe7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:00.236255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fc0af-2ea0-45ed-ad32-d75013047929 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:00.286074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc12d1-3a72-4ca9-9edc-1665d6c7666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:00.287026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc12d1-3a72-4ca9-9edc-1665d6c7666c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:00.287549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc12d1-3a72-4ca9-9edc-1665d6c7666c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:00.287549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc12d1-3a72-4ca9-9edc-1665d6c7666c None admin] PATH_INFO: `/v3/users/cdd6037917cc40ec98db3ee5284c7718` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:00.294123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc12d1-3a72-4ca9-9edc-1665d6c7666c None admin] RBAC: Authorizing `identity:get_user(user_id=cdd6037917cc40ec98db3ee5284c7718)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:00.295602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc12d1-3a72-4ca9-9edc-1665d6c7666c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:00.297331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 112/230] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:00 2022] GET /identity/v3/users/cdd6037917cc40ec98db3ee5284c7718 => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:00.302689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc12d1-3a72-4ca9-9edc-1665d6c7666c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:00.344160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610e57-ad19-4ba4-b483-cab905fffbe7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:00.380856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9d879-d8e5-4196-8e1d-0873c6ba41c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:00.381627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9d879-d8e5-4196-8e1d-0873c6ba41c7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:00.381926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9d879-d8e5-4196-8e1d-0873c6ba41c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:00.382198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9d879-d8e5-4196-8e1d-0873c6ba41c7 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:00.383892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9d879-d8e5-4196-8e1d-0873c6ba41c7 None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:00.385121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9d879-d8e5-4196-8e1d-0873c6ba41c7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:00.387338 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 119/231] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:00 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:00.394437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9d879-d8e5-4196-8e1d-0873c6ba41c7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:00.453966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc12d1-3a72-4ca9-9edc-1665d6c7666c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:00.491561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676753bf-6f64-4a4f-9b77-38ba01ef1419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:00.492811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676753bf-6f64-4a4f-9b77-38ba01ef1419 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:00.493325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676753bf-6f64-4a4f-9b77-38ba01ef1419 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:00.494644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676753bf-6f64-4a4f-9b77-38ba01ef1419 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:00.496170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676753bf-6f64-4a4f-9b77-38ba01ef1419 None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:00.497890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676753bf-6f64-4a4f-9b77-38ba01ef1419 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:00.500151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 113/232] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:00 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:00.505971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676753bf-6f64-4a4f-9b77-38ba01ef1419 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:00.564027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9d879-d8e5-4196-8e1d-0873c6ba41c7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:00.602632 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d4dc6-4e3d-4f6e-bd8f-1f4f3d8a216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:00.604819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4dc6-4e3d-4f6e-bd8f-1f4f3d8a216e None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:00.605104 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4dc6-4e3d-4f6e-bd8f-1f4f3d8a216e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:00.605411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4dc6-4e3d-4f6e-bd8f-1f4f3d8a216e None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/users/cdd6037917cc40ec98db3ee5284c7718/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:00.607522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d4dc6-4e3d-4f6e-bd8f-1f4f3d8a216e None admin] RBAC: Authorizing `identity:create_grant(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598, user_id=cdd6037917cc40ec98db3ee5284c7718, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:00.608954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d4dc6-4e3d-4f6e-bd8f-1f4f3d8a216e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:00.616728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676753bf-6f64-4a4f-9b77-38ba01ef1419 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:00.653673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc87055-4fd3-445b-8880-6ac232e8c070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:00.654962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc87055-4fd3-445b-8880-6ac232e8c070 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:00.655454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc87055-4fd3-445b-8880-6ac232e8c070 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:00.655932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc87055-4fd3-445b-8880-6ac232e8c070 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/users/cdd6037917cc40ec98db3ee5284c7718/roles/2f9013fc95d448a5b605f539fb6ae08f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:00.658600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc87055-4fd3-445b-8880-6ac232e8c070 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598, user_id=cdd6037917cc40ec98db3ee5284c7718, role_id=2f9013fc95d448a5b605f539fb6ae08f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:00.660313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc87055-4fd3-445b-8880-6ac232e8c070 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:00.705584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 120/233] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:17:00 2022] PUT /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/users/cdd6037917cc40ec98db3ee5284c7718/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:00.780220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 114/234] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:17:00 2022] PUT /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/users/cdd6037917cc40ec98db3ee5284c7718/roles/2f9013fc95d448a5b605f539fb6ae08f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:01.536590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8362bf-b85b-423f-bc11-6703f0923a52 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:01.537699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8362bf-b85b-423f-bc11-6703f0923a52 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:01.538217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8362bf-b85b-423f-bc11-6703f0923a52 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:01.539794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 121/235] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:17:01.558561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff1e7-e4c6-4ff0-9c35-e2498646ceca None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:01.559513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff1e7-e4c6-4ff0-9c35-e2498646ceca None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:01.560001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff1e7-e4c6-4ff0-9c35-e2498646ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:01.581822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a5aff1e7-e4c6-4ff0-9c35-e2498646ceca None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:01.583358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a5aff1e7-e4c6-4ff0-9c35-e2498646ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:01.680870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 115/236] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:01.734359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8362bf-b85b-423f-bc11-6703f0923a52 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:01.817250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0069-0088-4731-a6a8-20e14477742c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:01.817565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0069-0088-4731-a6a8-20e14477742c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:01.817774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe0069-0088-4731-a6a8-20e14477742c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:01.819369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 116/237] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:17:01.825172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c418c-1011-4f75-849f-e139f5aa49c5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:01.825487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c418c-1011-4f75-849f-e139f5aa49c5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:01.825774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c418c-1011-4f75-849f-e139f5aa49c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:01.857825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-759c418c-1011-4f75-849f-e139f5aa49c5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:01.859034 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-759c418c-1011-4f75-849f-e139f5aa49c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:01.880805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8362bf-b85b-423f-bc11-6703f0923a52 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:01.939333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a5098-82d8-44cc-8be7-87b5db8bf7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:01.940141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a5098-82d8-44cc-8be7-87b5db8bf7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:01.940424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a5098-82d8-44cc-8be7-87b5db8bf7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:01.940702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a5098-82d8-44cc-8be7-87b5db8bf7b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:01.968206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a5098-82d8-44cc-8be7-87b5db8bf7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-301a5098-82d8-44cc-8be7-87b5db8bf7b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:01.983524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:01.984424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:01.985307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:01.992076 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 122/238] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:01.996724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a5098-82d8-44cc-8be7-87b5db8bf7b0 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:02.018333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 117/239] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:02.060766 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c418c-1011-4f75-849f-e139f5aa49c5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:02.158142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a5098-82d8-44cc-8be7-87b5db8bf7b0 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:02.192761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4874a1a-a3b1-4050-b8af-77c9b9407504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:02.193470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4874a1a-a3b1-4050-b8af-77c9b9407504 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:02.193761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4874a1a-a3b1-4050-b8af-77c9b9407504 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:02.194046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4874a1a-a3b1-4050-b8af-77c9b9407504 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:02.194800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4874a1a-a3b1-4050-b8af-77c9b9407504 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:02.195110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4874a1a-a3b1-4050-b8af-77c9b9407504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:02.196489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4874a1a-a3b1-4050-b8af-77c9b9407504 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:02.205959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 123/240] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:02.211402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4874a1a-a3b1-4050-b8af-77c9b9407504 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:02.284682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c418c-1011-4f75-849f-e139f5aa49c5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:02.333140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac1801-f137-4dd4-9429-a05e1e07a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:02.333974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac1801-f137-4dd4-9429-a05e1e07a006 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:02.334257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac1801-f137-4dd4-9429-a05e1e07a006 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:02.334533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac1801-f137-4dd4-9429-a05e1e07a006 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:02.335724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac1801-f137-4dd4-9429-a05e1e07a006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:02.337201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac1801-f137-4dd4-9429-a05e1e07a006 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:02.339225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 118/241] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:02.339790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4874a1a-a3b1-4050-b8af-77c9b9407504 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:02.349306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac1801-f137-4dd4-9429-a05e1e07a006 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:02.418818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7189f-ac1d-49dd-9e12-261bb02e0426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:02.419646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7189f-ac1d-49dd-9e12-261bb02e0426 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:02.419932 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7189f-ac1d-49dd-9e12-261bb02e0426 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:02.420236 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7189f-ac1d-49dd-9e12-261bb02e0426 None admin] PATH_INFO: `/v3/users/25459429177e4a1db2543a55fa9c115e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:02.451932 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7189f-ac1d-49dd-9e12-261bb02e0426 None admin] RBAC: Authorizing `identity:get_user(user_id=25459429177e4a1db2543a55fa9c115e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:02.453435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7189f-ac1d-49dd-9e12-261bb02e0426 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:02.455191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 124/242] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:02 2022] GET /identity/v3/users/25459429177e4a1db2543a55fa9c115e => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:02.460821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7189f-ac1d-49dd-9e12-261bb02e0426 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:02.504374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac1801-f137-4dd4-9429-a05e1e07a006 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:02.579591 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fa5d3-5742-4c45-8561-d34c96c8a47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:02.581065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fa5d3-5742-4c45-8561-d34c96c8a47b None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:02.581569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fa5d3-5742-4c45-8561-d34c96c8a47b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:02.582040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fa5d3-5742-4c45-8561-d34c96c8a47b None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:02.582994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fa5d3-5742-4c45-8561-d34c96c8a47b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:02.584633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fa5d3-5742-4c45-8561-d34c96c8a47b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:02.626670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7189f-ac1d-49dd-9e12-261bb02e0426 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:02.667047 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a38fb-98c0-491f-a984-49ff992188e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:02.667709 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a38fb-98c0-491f-a984-49ff992188e8 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:02.667994 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a38fb-98c0-491f-a984-49ff992188e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:02.668276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a38fb-98c0-491f-a984-49ff992188e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:02.704642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 119/243] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:17:02 2022] POST /identity/v3/users => generated 293 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:17:02.743718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a38fb-98c0-491f-a984-49ff992188e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:02.746034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a38fb-98c0-491f-a984-49ff992188e8 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:02.861568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 125/244] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:02.868119 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fa5d3-5742-4c45-8561-d34c96c8a47b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:03.028418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fa5d3-5742-4c45-8561-d34c96c8a47b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:03.048630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c387880-6395-492e-8f11-74a92927858f None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.049043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c387880-6395-492e-8f11-74a92927858f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.049188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c387880-6395-492e-8f11-74a92927858f None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.051594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 126/245] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:03.068988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e375-e4cd-4967-82bd-5fcb18ed3e7f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.069321 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e375-e4cd-4967-82bd-5fcb18ed3e7f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.069596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e375-e4cd-4967-82bd-5fcb18ed3e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.072299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf4225-340a-41c4-aec5-8440f76e3df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:03.073502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf4225-340a-41c4-aec5-8440f76e3df9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.073993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf4225-340a-41c4-aec5-8440f76e3df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.074469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf4225-340a-41c4-aec5-8440f76e3df9 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.076299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf4225-340a-41c4-aec5-8440f76e3df9 None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:03.081338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf4225-340a-41c4-aec5-8440f76e3df9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:03.082079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 120/246] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:02 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:03.091742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf4225-340a-41c4-aec5-8440f76e3df9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:03.095319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-b1d8e375-e4cd-4967-82bd-5fcb18ed3e7f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:03.096531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b1d8e375-e4cd-4967-82bd-5fcb18ed3e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:03.185684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 127/247] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:03.210158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8e375-e4cd-4967-82bd-5fcb18ed3e7f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:03.218483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf4225-340a-41c4-aec5-8440f76e3df9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:03.266635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5450247-20f0-47f6-a16f-8ab448ed412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:03.267318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5450247-20f0-47f6-a16f-8ab448ed412b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.267608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5450247-20f0-47f6-a16f-8ab448ed412b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.267895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5450247-20f0-47f6-a16f-8ab448ed412b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.268880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5450247-20f0-47f6-a16f-8ab448ed412b None admin] RBAC: Adding query filter params (role.id=ef402940c145454090aa4eba58af85bf, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598, user.id=25459429177e4a1db2543a55fa9c115e) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:03.269070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5450247-20f0-47f6-a16f-8ab448ed412b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:03.270667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5450247-20f0-47f6-a16f-8ab448ed412b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:03.277231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 121/248] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:03 2022] GET /identity/v3/role_assignments?user.id=25459429177e4a1db2543a55fa9c115e&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=ef402940c145454090aa4eba58af85bf => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:03.336739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8e375-e4cd-4967-82bd-5fcb18ed3e7f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:03.376253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092be90f-3e81-48a9-b09a-7f0fa2413670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:03.377493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092be90f-3e81-48a9-b09a-7f0fa2413670 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.378029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092be90f-3e81-48a9-b09a-7f0fa2413670 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.378507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092be90f-3e81-48a9-b09a-7f0fa2413670 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.391454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092be90f-3e81-48a9-b09a-7f0fa2413670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-092be90f-3e81-48a9-b09a-7f0fa2413670 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:03.400335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:03.401324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:03.402119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:03.405032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 128/249] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:03.411762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5450247-20f0-47f6-a16f-8ab448ed412b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:03.551145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5450247-20f0-47f6-a16f-8ab448ed412b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:03.592048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62e661-e656-4754-87aa-062b9ace22c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:03.592653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e661-e656-4754-87aa-062b9ace22c4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.592931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e661-e656-4754-87aa-062b9ace22c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.593211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e661-e656-4754-87aa-062b9ace22c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.594007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62e661-e656-4754-87aa-062b9ace22c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:03.594315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62e661-e656-4754-87aa-062b9ace22c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:03.595730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62e661-e656-4754-87aa-062b9ace22c4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:03.609323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 122/250] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:03.614670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092be90f-3e81-48a9-b09a-7f0fa2413670 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:03.667284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35332-651b-4acc-adc8-57556530d0f8 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.667600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35332-651b-4acc-adc8-57556530d0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.667885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d35332-651b-4acc-adc8-57556530d0f8 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.669238 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 123/251] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:17:03.675073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4bf9-8975-466b-81df-9ae0703cc4ad None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.675372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4bf9-8975-466b-81df-9ae0703cc4ad None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.675663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4bf9-8975-466b-81df-9ae0703cc4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.700088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-34ee4bf9-8975-466b-81df-9ae0703cc4ad None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:03.701309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-34ee4bf9-8975-466b-81df-9ae0703cc4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:03.755119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092be90f-3e81-48a9-b09a-7f0fa2413670 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:03.795402 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 124/252] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:03.796782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fecd6-9104-418b-aa3f-899a1ebb5d6a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.797082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fecd6-9104-418b-aa3f-899a1ebb5d6a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.797400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fecd6-9104-418b-aa3f-899a1ebb5d6a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.805318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 125/253] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:03.808401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012d1d4-2904-4fef-90eb-bf28b0a995d9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.808877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012d1d4-2904-4fef-90eb-bf28b0a995d9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.809218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012d1d4-2904-4fef-90eb-bf28b0a995d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.813966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf060d58-a771-4ec6-9d84-e2fd0f7bcf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:03.814867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf060d58-a771-4ec6-9d84-e2fd0f7bcf06 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:03.815217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf060d58-a771-4ec6-9d84-e2fd0f7bcf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:03.815503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf060d58-a771-4ec6-9d84-e2fd0f7bcf06 None admin] PATH_INFO: `/v3/users/600a3b603a0146b2bf55dfbcd8f2a370` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:03.819313 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf060d58-a771-4ec6-9d84-e2fd0f7bcf06 None admin] RBAC: Authorizing `identity:get_user(user_id=600a3b603a0146b2bf55dfbcd8f2a370)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:03.821192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf060d58-a771-4ec6-9d84-e2fd0f7bcf06 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:03.830950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 129/254] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:03 2022] GET /identity/v3/users/600a3b603a0146b2bf55dfbcd8f2a370 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:03.834714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf060d58-a771-4ec6-9d84-e2fd0f7bcf06 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:03.850446 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8012d1d4-2904-4fef-90eb-bf28b0a995d9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:03.851586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8012d1d4-2904-4fef-90eb-bf28b0a995d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:03.967285 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 126/255] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:03.967476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf060d58-a771-4ec6-9d84-e2fd0f7bcf06 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:03.968141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012d1d4-2904-4fef-90eb-bf28b0a995d9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:04.024653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330580ec-5cba-4194-9f4f-07c69b8a41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:04.025654 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330580ec-5cba-4194-9f4f-07c69b8a41c9 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:04.025937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330580ec-5cba-4194-9f4f-07c69b8a41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:04.026217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330580ec-5cba-4194-9f4f-07c69b8a41c9 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:04.027506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330580ec-5cba-4194-9f4f-07c69b8a41c9 None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:04.028989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330580ec-5cba-4194-9f4f-07c69b8a41c9 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:04.031120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 130/256] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:03 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:04.031950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330580ec-5cba-4194-9f4f-07c69b8a41c9 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:04.135309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012d1d4-2904-4fef-90eb-bf28b0a995d9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:04.173088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330580ec-5cba-4194-9f4f-07c69b8a41c9 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:04.217869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28ebe0-83a4-4576-9615-8d0827d8c87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:04.218687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28ebe0-83a4-4576-9615-8d0827d8c87f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:04.218970 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28ebe0-83a4-4576-9615-8d0827d8c87f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:04.219247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28ebe0-83a4-4576-9615-8d0827d8c87f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:04.234057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657852c-7dc0-4617-9ed0-789d036e1341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:04.234886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657852c-7dc0-4617-9ed0-789d036e1341 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:04.235173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657852c-7dc0-4617-9ed0-789d036e1341 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:04.235451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657852c-7dc0-4617-9ed0-789d036e1341 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:04.240446 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28ebe0-83a4-4576-9615-8d0827d8c87f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-4d28ebe0-83a4-4576-9615-8d0827d8c87f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:04.255269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:04.256220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:04.256990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:04.258545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 127/257] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:17:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:04.258545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28ebe0-83a4-4576-9615-8d0827d8c87f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:04.262075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657852c-7dc0-4617-9ed0-789d036e1341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-a657852c-7dc0-4617-9ed0-789d036e1341 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:04.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:04.272638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 131/258] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:17:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:04.276403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657852c-7dc0-4617-9ed0-789d036e1341 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:04.403259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28ebe0-83a4-4576-9615-8d0827d8c87f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:04.441562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af1e0b-0312-4d64-9cdc-67343bf46544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:04.443340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af1e0b-0312-4d64-9cdc-67343bf46544 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:04.443851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af1e0b-0312-4d64-9cdc-67343bf46544 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:04.444347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af1e0b-0312-4d64-9cdc-67343bf46544 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/users/600a3b603a0146b2bf55dfbcd8f2a370/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:04.447672 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af1e0b-0312-4d64-9cdc-67343bf46544 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598, user_id=600a3b603a0146b2bf55dfbcd8f2a370, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:04.449744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af1e0b-0312-4d64-9cdc-67343bf46544 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:04.497762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657852c-7dc0-4617-9ed0-789d036e1341 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:04.527314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 128/259] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:17:04 2022] PUT /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/users/600a3b603a0146b2bf55dfbcd8f2a370/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:04.528592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af1e0b-0312-4d64-9cdc-67343bf46544 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:04.562017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74896c17-e1c1-41d1-8277-8ca5b55a0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:04.563083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896c17-e1c1-41d1-8277-8ca5b55a0a5c None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:04.563696 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896c17-e1c1-41d1-8277-8ca5b55a0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:04.565367 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74896c17-e1c1-41d1-8277-8ca5b55a0a5c None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:04.566784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74896c17-e1c1-41d1-8277-8ca5b55a0a5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:04.568553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74896c17-e1c1-41d1-8277-8ca5b55a0a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:04.570376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74896c17-e1c1-41d1-8277-8ca5b55a0a5c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:04.588711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 132/260] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:04.596084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74896c17-e1c1-41d1-8277-8ca5b55a0a5c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:04.739706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af1e0b-0312-4d64-9cdc-67343bf46544 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:04.786570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74896c17-e1c1-41d1-8277-8ca5b55a0a5c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:04.825523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09c877-44c8-46ca-8afe-d3c2f7e50bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:04.826840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09c877-44c8-46ca-8afe-d3c2f7e50bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:04.827320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09c877-44c8-46ca-8afe-d3c2f7e50bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:04.827790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09c877-44c8-46ca-8afe-d3c2f7e50bc7 None admin] PATH_INFO: `/v3/users/cdd6037917cc40ec98db3ee5284c7718` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:04.829470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09c877-44c8-46ca-8afe-d3c2f7e50bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=cdd6037917cc40ec98db3ee5284c7718)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:04.831149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09c877-44c8-46ca-8afe-d3c2f7e50bc7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:04.837494 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 133/261] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:04 2022] GET /identity/v3/users/cdd6037917cc40ec98db3ee5284c7718 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:04.839733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09c877-44c8-46ca-8afe-d3c2f7e50bc7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:04.847040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbc734-08af-46be-ae3f-f83535e2a4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:04.848128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbc734-08af-46be-ae3f-f83535e2a4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:04.848632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbc734-08af-46be-ae3f-f83535e2a4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:04.849144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbc734-08af-46be-ae3f-f83535e2a4e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:04.850650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbc734-08af-46be-ae3f-f83535e2a4e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:04.851430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbc734-08af-46be-ae3f-f83535e2a4e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:04.852468 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbc734-08af-46be-ae3f-f83535e2a4e6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:04.884839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 129/262] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:04.892658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbc734-08af-46be-ae3f-f83535e2a4e6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:04.969911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09c877-44c8-46ca-8afe-d3c2f7e50bc7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:05.007583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebff341-0386-44b5-9ee0-b3a4558a197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:05.008642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebff341-0386-44b5-9ee0-b3a4558a197d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:05.009843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebff341-0386-44b5-9ee0-b3a4558a197d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:05.010560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebff341-0386-44b5-9ee0-b3a4558a197d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:05.084987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebff341-0386-44b5-9ee0-b3a4558a197d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:05.086812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebff341-0386-44b5-9ee0-b3a4558a197d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:05.145217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbc734-08af-46be-ae3f-f83535e2a4e6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:05.197489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 134/263] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 20:17:05.201044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebff341-0386-44b5-9ee0-b3a4558a197d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:05.247651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761623d0-60a2-4520-a7ed-9d47c0892e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:05.249218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761623d0-60a2-4520-a7ed-9d47c0892e6c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:05.249486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761623d0-60a2-4520-a7ed-9d47c0892e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:05.249915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761623d0-60a2-4520-a7ed-9d47c0892e6c None admin] PATH_INFO: `/v3/users/cdd6037917cc40ec98db3ee5284c7718` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:05.254374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761623d0-60a2-4520-a7ed-9d47c0892e6c None admin] RBAC: Authorizing `identity:get_user(user_id=cdd6037917cc40ec98db3ee5284c7718)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:05.257000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761623d0-60a2-4520-a7ed-9d47c0892e6c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:05.260258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 130/264] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:04 2022] GET /identity/v3/users/cdd6037917cc40ec98db3ee5284c7718 => generated 283 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:05.268107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761623d0-60a2-4520-a7ed-9d47c0892e6c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:05.347438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebff341-0386-44b5-9ee0-b3a4558a197d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:05.408193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761623d0-60a2-4520-a7ed-9d47c0892e6c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:05.420813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba741a-6f27-4952-a4ca-c056703d54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:05.422054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba741a-6f27-4952-a4ca-c056703d54ca None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:05.422556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba741a-6f27-4952-a4ca-c056703d54ca None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:05.423044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba741a-6f27-4952-a4ca-c056703d54ca None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:05.424998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba741a-6f27-4952-a4ca-c056703d54ca None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:05.426656 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba741a-6f27-4952-a4ca-c056703d54ca None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:05.429821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 135/265] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:05 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:05.449163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba741a-6f27-4952-a4ca-c056703d54ca None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:05.482675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff509b-ab62-473e-8c03-3802a1613e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:05.483918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff509b-ab62-473e-8c03-3802a1613e90 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:05.485668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff509b-ab62-473e-8c03-3802a1613e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:05.486187 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff509b-ab62-473e-8c03-3802a1613e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:05.589244 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba741a-6f27-4952-a4ca-c056703d54ca None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:05.637374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f31e4-0805-45a1-8f8c-3b8dad016b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:05.638054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f31e4-0805-45a1-8f8c-3b8dad016b1a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:05.638339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f31e4-0805-45a1-8f8c-3b8dad016b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:05.638617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f31e4-0805-45a1-8f8c-3b8dad016b1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:05.641327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f31e4-0805-45a1-8f8c-3b8dad016b1a None admin] RBAC: Adding query filter params (role.id=2f9013fc95d448a5b605f539fb6ae08f, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598, user.id=cdd6037917cc40ec98db3ee5284c7718) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:05.641327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f31e4-0805-45a1-8f8c-3b8dad016b1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:05.642423 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f31e4-0805-45a1-8f8c-3b8dad016b1a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:05.653497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 136/266] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:05 2022] GET /identity/v3/role_assignments?user.id=cdd6037917cc40ec98db3ee5284c7718&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=2f9013fc95d448a5b605f539fb6ae08f => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:05.666203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff509b-ab62-473e-8c03-3802a1613e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:05.667694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff509b-ab62-473e-8c03-3802a1613e90 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:05.778350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 131/267] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:05.786497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f31e4-0805-45a1-8f8c-3b8dad016b1a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:05.937668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f31e4-0805-45a1-8f8c-3b8dad016b1a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:05.981158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2f8c-05cd-4004-bd5f-527f4c48316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:05.983538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2f8c-05cd-4004-bd5f-527f4c48316b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:05.983538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2f8c-05cd-4004-bd5f-527f4c48316b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:05.983538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2f8c-05cd-4004-bd5f-527f4c48316b None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:05.984027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2f8c-05cd-4004-bd5f-527f4c48316b None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:05.985507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2f8c-05cd-4004-bd5f-527f4c48316b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:05.987547 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 137/268] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:05 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:05.993110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff509b-ab62-473e-8c03-3802a1613e90 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:06.111473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff509b-ab62-473e-8c03-3802a1613e90 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:06.153640 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933be9a1-f01d-4320-97bb-e58f61b581ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:06.154245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933be9a1-f01d-4320-97bb-e58f61b581ee None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:06.154533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933be9a1-f01d-4320-97bb-e58f61b581ee None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:06.154815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933be9a1-f01d-4320-97bb-e58f61b581ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:06.155667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933be9a1-f01d-4320-97bb-e58f61b581ee None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598, user.id=cdd6037917cc40ec98db3ee5284c7718) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:06.155983 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933be9a1-f01d-4320-97bb-e58f61b581ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:06.157470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933be9a1-f01d-4320-97bb-e58f61b581ee None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:06.164615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 132/269] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:05 2022] GET /identity/v3/role_assignments?user.id=cdd6037917cc40ec98db3ee5284c7718&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=4ae0665802b946be870ab06274297a1d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:06.273615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed2e3-57c6-4b93-a37f-737348993407 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:06.273944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed2e3-57c6-4b93-a37f-737348993407 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:06.274179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed2e3-57c6-4b93-a37f-737348993407 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:06.276149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 138/270] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:06.282204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4458565-f11b-4120-a26f-fead27c6e29f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:06.282504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4458565-f11b-4120-a26f-fead27c6e29f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:06.282777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4458565-f11b-4120-a26f-fead27c6e29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:06.302735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b4458565-f11b-4120-a26f-fead27c6e29f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:06.303969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b4458565-f11b-4120-a26f-fead27c6e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:06.401304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 133/271] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:06.437729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed2e3-57c6-4b93-a37f-737348993407 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:06.549659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3f771-e3fb-4f4f-a2be-bd74f24b0266 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:06.550009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3f771-e3fb-4f4f-a2be-bd74f24b0266 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:06.550221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3f771-e3fb-4f4f-a2be-bd74f24b0266 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:06.551604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 134/272] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:17:06.558349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eece0-9872-4571-a69a-46abb6721082 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:06.558630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eece0-9872-4571-a69a-46abb6721082 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:06.558912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eece0-9872-4571-a69a-46abb6721082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:06.571984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed2e3-57c6-4b93-a37f-737348993407 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:06.583200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-579eece0-9872-4571-a69a-46abb6721082 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:06.584460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-579eece0-9872-4571-a69a-46abb6721082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:06.620782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373e853-41eb-42d6-97a2-a243f72ad182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:06.621885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e853-41eb-42d6-97a2-a243f72ad182 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:06.622121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e853-41eb-42d6-97a2-a243f72ad182 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:06.622736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e853-41eb-42d6-97a2-a243f72ad182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:06.624413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373e853-41eb-42d6-97a2-a243f72ad182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:06.626480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373e853-41eb-42d6-97a2-a243f72ad182 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:06.628659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 139/273] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:06.636085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373e853-41eb-42d6-97a2-a243f72ad182 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:06.680320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 135/274] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:06.709219 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eece0-9872-4571-a69a-46abb6721082 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:06.748259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373e853-41eb-42d6-97a2-a243f72ad182 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:06.783777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63ae7e-8e0d-4cfc-b2fa-fdca95c3d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:06.784521 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63ae7e-8e0d-4cfc-b2fa-fdca95c3d418 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:06.784814 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63ae7e-8e0d-4cfc-b2fa-fdca95c3d418 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:06.785096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63ae7e-8e0d-4cfc-b2fa-fdca95c3d418 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:06.785855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63ae7e-8e0d-4cfc-b2fa-fdca95c3d418 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:06.787319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63ae7e-8e0d-4cfc-b2fa-fdca95c3d418 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:06.817642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eece0-9872-4571-a69a-46abb6721082 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:06.852877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1bc9b-6ef9-440c-8c64-ca95eeeaca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:06.853810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1bc9b-6ef9-440c-8c64-ca95eeeaca0c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:06.854090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1bc9b-6ef9-440c-8c64-ca95eeeaca0c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:06.854367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1bc9b-6ef9-440c-8c64-ca95eeeaca0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:06.873067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1bc9b-6ef9-440c-8c64-ca95eeeaca0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b3c1bc9b-6ef9-440c-8c64-ca95eeeaca0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:06.881193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 136/275] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:06.888737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d95418-9d6b-4991-873c-1d431881ba16 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:06.889567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d95418-9d6b-4991-873c-1d431881ba16 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:06.889567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d95418-9d6b-4991-873c-1d431881ba16 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:06.889567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 137/276] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:06.890317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d95418-9d6b-4991-873c-1d431881ba16 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:06.895325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 140/277] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:17:06 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:17:06.902897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abfe73-b947-473f-a723-679c4b815940 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:06.903197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abfe73-b947-473f-a723-679c4b815940 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:06.903484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abfe73-b947-473f-a723-679c4b815940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:06.939004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f8abfe73-b947-473f-a723-679c4b815940 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:06.940413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f8abfe73-b947-473f-a723-679c4b815940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:07.033389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 141/278] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:07.053970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abfe73-b947-473f-a723-679c4b815940 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:07.062884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d95418-9d6b-4991-873c-1d431881ba16 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:07.113015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05becd2f-49f9-43ff-8ea8-87982504ba57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:07.113681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05becd2f-49f9-43ff-8ea8-87982504ba57 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:07.114176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05becd2f-49f9-43ff-8ea8-87982504ba57 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:07.114651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05becd2f-49f9-43ff-8ea8-87982504ba57 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:07.116013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05becd2f-49f9-43ff-8ea8-87982504ba57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:07.116552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05becd2f-49f9-43ff-8ea8-87982504ba57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:07.120031 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05becd2f-49f9-43ff-8ea8-87982504ba57 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:07.129596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 138/279] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:07.136874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05becd2f-49f9-43ff-8ea8-87982504ba57 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:07.200080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abfe73-b947-473f-a723-679c4b815940 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:07.250514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b31890-cb25-4d5d-95b0-08e245d95ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:07.251765 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b31890-cb25-4d5d-95b0-08e245d95ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:07.252333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b31890-cb25-4d5d-95b0-08e245d95ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:07.252620 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b31890-cb25-4d5d-95b0-08e245d95ba8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:07.269467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b31890-cb25-4d5d-95b0-08e245d95ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:07.274643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05becd2f-49f9-43ff-8ea8-87982504ba57 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-39b31890-cb25-4d5d-95b0-08e245d95ba8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:07.277428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:07.278341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:07.279145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 142/280] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:07.284821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b31890-cb25-4d5d-95b0-08e245d95ba8 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:07.325882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e85cb4-f786-463c-991d-9b80810ee4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:07.327380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e85cb4-f786-463c-991d-9b80810ee4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:07.327610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e85cb4-f786-463c-991d-9b80810ee4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:07.328164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e85cb4-f786-463c-991d-9b80810ee4f5 None admin] PATH_INFO: `/v3/users/25459429177e4a1db2543a55fa9c115e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:07.329719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e85cb4-f786-463c-991d-9b80810ee4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=25459429177e4a1db2543a55fa9c115e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:07.331561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e85cb4-f786-463c-991d-9b80810ee4f5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:07.333251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 139/281] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:07 2022] GET /identity/v3/users/25459429177e4a1db2543a55fa9c115e => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:07.342398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e85cb4-f786-463c-991d-9b80810ee4f5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:07.419241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b31890-cb25-4d5d-95b0-08e245d95ba8 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:07.456765 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087c737-017f-4e86-95a8-b4158b406374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:07.457834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087c737-017f-4e86-95a8-b4158b406374 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:07.458349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087c737-017f-4e86-95a8-b4158b406374 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:07.458793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e85cb4-f786-463c-991d-9b80810ee4f5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:07.459023 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087c737-017f-4e86-95a8-b4158b406374 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:07.459962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087c737-017f-4e86-95a8-b4158b406374 None admin] RBAC: Adding query filter params (name=member) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:07.460451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087c737-017f-4e86-95a8-b4158b406374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:07.462583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087c737-017f-4e86-95a8-b4158b406374 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:07.471948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 143/282] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:07.489695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087c737-017f-4e86-95a8-b4158b406374 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:07.500593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c59a3c-98ee-462c-b64b-089ec8663a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:07.501595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59a3c-98ee-462c-b64b-089ec8663a98 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:07.501951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59a3c-98ee-462c-b64b-089ec8663a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:07.502291 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59a3c-98ee-462c-b64b-089ec8663a98 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:07.503637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c59a3c-98ee-462c-b64b-089ec8663a98 None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:07.505168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c59a3c-98ee-462c-b64b-089ec8663a98 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:07.512102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 140/283] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:07 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:07.514073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c59a3c-98ee-462c-b64b-089ec8663a98 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:07.647310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c59a3c-98ee-462c-b64b-089ec8663a98 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:07.686092 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f9035-40c9-4dd0-b257-02205a1e8442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:07.687024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f9035-40c9-4dd0-b257-02205a1e8442 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:07.687313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f9035-40c9-4dd0-b257-02205a1e8442 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:07.687595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f9035-40c9-4dd0-b257-02205a1e8442 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/users/25459429177e4a1db2543a55fa9c115e/roles/ef402940c145454090aa4eba58af85bf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:07.689902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f9035-40c9-4dd0-b257-02205a1e8442 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598, user_id=25459429177e4a1db2543a55fa9c115e, role_id=ef402940c145454090aa4eba58af85bf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:07.691400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f9035-40c9-4dd0-b257-02205a1e8442 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:07.713533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087c737-017f-4e86-95a8-b4158b406374 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:07.751216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b8783-c93e-40a2-b47a-69cc72684d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:07.752188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b8783-c93e-40a2-b47a-69cc72684d2a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:07.752478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b8783-c93e-40a2-b47a-69cc72684d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:07.752760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b8783-c93e-40a2-b47a-69cc72684d2a None admin] PATH_INFO: `/v3/users/59f7165511d449799dc34703b2fdd2d4` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:07.767351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 141/284] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:17:07 2022] PUT /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/users/25459429177e4a1db2543a55fa9c115e/roles/ef402940c145454090aa4eba58af85bf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:17:07.779749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b8783-c93e-40a2-b47a-69cc72684d2a None admin] RBAC: Authorizing `identity:get_user(user_id=59f7165511d449799dc34703b2fdd2d4)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:07.781389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b8783-c93e-40a2-b47a-69cc72684d2a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:07.783749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 144/285] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:07 2022] GET /identity/v3/users/59f7165511d449799dc34703b2fdd2d4 => generated 293 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:07.789650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f9035-40c9-4dd0-b257-02205a1e8442 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:07.878910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c97d1-d267-449c-bb12-7a3131abc839 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:07.879217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c97d1-d267-449c-bb12-7a3131abc839 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:07.879642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c97d1-d267-449c-bb12-7a3131abc839 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:07.881165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 145/286] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:07.888224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd1fe8-0f2e-4c56-bf45-5d8e90d86a71 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:07.888616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd1fe8-0f2e-4c56-bf45-5d8e90d86a71 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:07.888978 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd1fe8-0f2e-4c56-bf45-5d8e90d86a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:07.923953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-84dd1fe8-0f2e-4c56-bf45-5d8e90d86a71 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:07.925201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-84dd1fe8-0f2e-4c56-bf45-5d8e90d86a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:07.966578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f9035-40c9-4dd0-b257-02205a1e8442 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:08.003941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb178093-6d9d-45ad-9f62-73707cf1b9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:08.004681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb178093-6d9d-45ad-9f62-73707cf1b9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:08.004972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb178093-6d9d-45ad-9f62-73707cf1b9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:08.005254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb178093-6d9d-45ad-9f62-73707cf1b9f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:08.006150 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb178093-6d9d-45ad-9f62-73707cf1b9f5 None admin] RBAC: Adding query filter params (role.id=4982f0e43bc8430d81d3906431eff62e, user.id=59f7165511d449799dc34703b2fdd2d4, scope.system=all) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:08.006472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb178093-6d9d-45ad-9f62-73707cf1b9f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:08.007950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb178093-6d9d-45ad-9f62-73707cf1b9f5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:08.015314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 142/287] 10.222.0.59 () {56 vars in 1308 bytes} [Thu May 12 20:17:07 2022] GET /identity/v3/role_assignments?user.id=59f7165511d449799dc34703b2fdd2d4&scope.system=all&role.id=4982f0e43bc8430d81d3906431eff62e => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:08.092849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 146/288] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:08.115724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb178093-6d9d-45ad-9f62-73707cf1b9f5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:08.271717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb178093-6d9d-45ad-9f62-73707cf1b9f5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:08.318957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d46d4-6ffc-47f5-ae89-8f0e9ffa2d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:08.319783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d46d4-6ffc-47f5-ae89-8f0e9ffa2d52 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:08.320073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d46d4-6ffc-47f5-ae89-8f0e9ffa2d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:08.320357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d46d4-6ffc-47f5-ae89-8f0e9ffa2d52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:08.335639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d46d4-6ffc-47f5-ae89-8f0e9ffa2d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-642d46d4-6ffc-47f5-ae89-8f0e9ffa2d52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:08.343481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:08.344398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:08.345183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 143/289] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:08.350708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd1fe8-0f2e-4c56-bf45-5d8e90d86a71 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:08.506817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd1fe8-0f2e-4c56-bf45-5d8e90d86a71 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:08.554322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a50222-4584-4dee-92db-992fcbd361f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:08.555357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a50222-4584-4dee-92db-992fcbd361f6 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:08.555919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a50222-4584-4dee-92db-992fcbd361f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:08.557356 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a50222-4584-4dee-92db-992fcbd361f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:08.558469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a50222-4584-4dee-92db-992fcbd361f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:08.559032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a50222-4584-4dee-92db-992fcbd361f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:08.560699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a50222-4584-4dee-92db-992fcbd361f6 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:08.579666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 147/290] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:08.585329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d46d4-6ffc-47f5-ae89-8f0e9ffa2d52 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:08.730696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d46d4-6ffc-47f5-ae89-8f0e9ffa2d52 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:08.772857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f19e2-3001-49e8-b5fd-9f1a6566f6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:08.773790 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f19e2-3001-49e8-b5fd-9f1a6566f6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:08.774078 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f19e2-3001-49e8-b5fd-9f1a6566f6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:08.774382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f19e2-3001-49e8-b5fd-9f1a6566f6f2 None admin] PATH_INFO: `/v3/users/600a3b603a0146b2bf55dfbcd8f2a370` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:08.776592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f19e2-3001-49e8-b5fd-9f1a6566f6f2 None admin] RBAC: Authorizing `identity:get_user(user_id=600a3b603a0146b2bf55dfbcd8f2a370)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:08.778104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f19e2-3001-49e8-b5fd-9f1a6566f6f2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:08.779799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 144/291] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:08 2022] GET /identity/v3/users/600a3b603a0146b2bf55dfbcd8f2a370 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:08.785493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a50222-4584-4dee-92db-992fcbd361f6 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:08.944151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a50222-4584-4dee-92db-992fcbd361f6 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:08.995954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71adeb-e730-427e-acb4-62e87e121858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:08.996633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71adeb-e730-427e-acb4-62e87e121858 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:08.996916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71adeb-e730-427e-acb4-62e87e121858 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:08.997193 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71adeb-e730-427e-acb4-62e87e121858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:09.090622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71adeb-e730-427e-acb4-62e87e121858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:09.092378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71adeb-e730-427e-acb4-62e87e121858 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:09.224497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 148/292] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:09.230535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f19e2-3001-49e8-b5fd-9f1a6566f6f2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:09.358098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f19e2-3001-49e8-b5fd-9f1a6566f6f2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:09.406045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdd95b-0879-4532-975b-89d55c3f0ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:09.407330 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd95b-0879-4532-975b-89d55c3f0ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:09.407817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd95b-0879-4532-975b-89d55c3f0ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:09.408291 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd95b-0879-4532-975b-89d55c3f0ea1 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:09.409818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdd95b-0879-4532-975b-89d55c3f0ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:09.411483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdd95b-0879-4532-975b-89d55c3f0ea1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:09.413749 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 145/293] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:09 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:09.419425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71adeb-e730-427e-acb4-62e87e121858 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:09.574172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71adeb-e730-427e-acb4-62e87e121858 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:09.623183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ce41c-eeda-49bd-b9d8-549536ce6881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:09.623858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ce41c-eeda-49bd-b9d8-549536ce6881 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:09.624141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ce41c-eeda-49bd-b9d8-549536ce6881 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:09.624422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ce41c-eeda-49bd-b9d8-549536ce6881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:09.625330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ce41c-eeda-49bd-b9d8-549536ce6881 None admin] RBAC: Adding query filter params (role.id=4982f0e43bc8430d81d3906431eff62e, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598, user.id=600a3b603a0146b2bf55dfbcd8f2a370) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:09.625702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ce41c-eeda-49bd-b9d8-549536ce6881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:09.627238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ce41c-eeda-49bd-b9d8-549536ce6881 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:09.639188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 149/294] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:09 2022] GET /identity/v3/role_assignments?user.id=600a3b603a0146b2bf55dfbcd8f2a370&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=4982f0e43bc8430d81d3906431eff62e => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:10.060297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe833ba-2799-4647-98aa-74df3363a526 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.061014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe833ba-2799-4647-98aa-74df3363a526 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.061521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe833ba-2799-4647-98aa-74df3363a526 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.063466 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 146/295] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:10.068889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae40db-220c-43c8-8023-3491ff5cebf9 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.069495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae40db-220c-43c8-8023-3491ff5cebf9 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.069967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae40db-220c-43c8-8023-3491ff5cebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.090500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-aeae40db-220c-43c8-8023-3491ff5cebf9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:10.092235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-aeae40db-220c-43c8-8023-3491ff5cebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:10.115051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf3a3-4c25-4fdc-b1ee-97e1a772394b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.115649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf3a3-4c25-4fdc-b1ee-97e1a772394b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.116131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf3a3-4c25-4fdc-b1ee-97e1a772394b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.118022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 147/296] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:10.125611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e50d0-cc58-479e-ba56-795e5c9379ed None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.126210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e50d0-cc58-479e-ba56-795e5c9379ed None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.126689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e50d0-cc58-479e-ba56-795e5c9379ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.149366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-380e50d0-cc58-479e-ba56-795e5c9379ed None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:10.151690 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-380e50d0-cc58-479e-ba56-795e5c9379ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:10.175693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 150/297] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:10.198303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae40db-220c-43c8-8023-3491ff5cebf9 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:10.241112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 148/298] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:10.280770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e50d0-cc58-479e-ba56-795e5c9379ed None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:10.331501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae40db-220c-43c8-8023-3491ff5cebf9 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:10.367341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cc689-dc00-49da-bd45-f48027bef811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:10.368602 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc689-dc00-49da-bd45-f48027bef811 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.369070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc689-dc00-49da-bd45-f48027bef811 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.369801 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc689-dc00-49da-bd45-f48027bef811 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.371196 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cc689-dc00-49da-bd45-f48027bef811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:10.372851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cc689-dc00-49da-bd45-f48027bef811 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:10.379455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 151/299] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:10.380566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cc689-dc00-49da-bd45-f48027bef811 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:10.387538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e50d0-cc58-479e-ba56-795e5c9379ed None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:10.424678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b06b-26dc-49cb-a561-b5335d37abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:10.425372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b06b-26dc-49cb-a561-b5335d37abf9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.425656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b06b-26dc-49cb-a561-b5335d37abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.425928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b06b-26dc-49cb-a561-b5335d37abf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.438358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393b06b-26dc-49cb-a561-b5335d37abf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8393b06b-26dc-49cb-a561-b5335d37abf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:10.446116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:10.447748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:10.448530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:10.453957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 149/300] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:10.456160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b06b-26dc-49cb-a561-b5335d37abf9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:10.500630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cc689-dc00-49da-bd45-f48027bef811 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:10.540998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183406b-4c36-49d6-ad58-de669ed7fd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:10.541912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183406b-4c36-49d6-ad58-de669ed7fd7f None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.542202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183406b-4c36-49d6-ad58-de669ed7fd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.542482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183406b-4c36-49d6-ad58-de669ed7fd7f None admin] PATH_INFO: `/v3/groups` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.544138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183406b-4c36-49d6-ad58-de669ed7fd7f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:10.545681 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183406b-4c36-49d6-ad58-de669ed7fd7f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:10.579064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b06b-26dc-49cb-a561-b5335d37abf9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:10.615984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f38df9-4c08-4a99-99fc-942c0e60957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:10.616565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f38df9-4c08-4a99-99fc-942c0e60957e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.616855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f38df9-4c08-4a99-99fc-942c0e60957e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.617139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f38df9-4c08-4a99-99fc-942c0e60957e None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.618516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f38df9-4c08-4a99-99fc-942c0e60957e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:10.618820 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f38df9-4c08-4a99-99fc-942c0e60957e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:10.620608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f38df9-4c08-4a99-99fc-942c0e60957e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:10.631605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 150/301] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:10.636864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 152/302] 10.222.0.59 () {60 vars in 1134 bytes} [Thu May 12 20:17:10 2022] POST /identity/v3/groups => generated 229 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:17:10.643121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f38df9-4c08-4a99-99fc-942c0e60957e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:10.764945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab4aff-2d8c-49d0-a661-17a6bb2d9d95 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.765609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab4aff-2d8c-49d0-a661-17a6bb2d9d95 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.766149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab4aff-2d8c-49d0-a661-17a6bb2d9d95 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.774078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 153/303] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:10.774416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f38df9-4c08-4a99-99fc-942c0e60957e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:10.776182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624886e5-2dec-4a43-adad-2dcf15808ccc None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.776586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624886e5-2dec-4a43-adad-2dcf15808ccc None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.777624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624886e5-2dec-4a43-adad-2dcf15808ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.802815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-624886e5-2dec-4a43-adad-2dcf15808ccc None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:10.804679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-624886e5-2dec-4a43-adad-2dcf15808ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:10.824037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf2e7f-985a-49f9-971d-f3f6c4e8fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:10.824949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf2e7f-985a-49f9-971d-f3f6c4e8fc94 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.825236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf2e7f-985a-49f9-971d-f3f6c4e8fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.825570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf2e7f-985a-49f9-971d-f3f6c4e8fc94 None admin] PATH_INFO: `/v3/users/4246b99f33614dc28772038f56467e55` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.841956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf2e7f-985a-49f9-971d-f3f6c4e8fc94 None admin] RBAC: Authorizing `identity:get_user(user_id=4246b99f33614dc28772038f56467e55)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:10.843446 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf2e7f-985a-49f9-971d-f3f6c4e8fc94 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:10.850783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 151/304] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:10 2022] GET /identity/v3/users/4246b99f33614dc28772038f56467e55 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:10.850783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938ed4-8d5d-4c11-be5a-af6285ae3890 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.850783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938ed4-8d5d-4c11-be5a-af6285ae3890 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.850783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938ed4-8d5d-4c11-be5a-af6285ae3890 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.850783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 152/305] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:10.853965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae938ed4-8d5d-4c11-be5a-af6285ae3890 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:10.900631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 154/306] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:10.902542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8a542-ffb8-4cca-af9e-588fb593a1ad None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:10.902865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8a542-ffb8-4cca-af9e-588fb593a1ad None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:10.903157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8a542-ffb8-4cca-af9e-588fb593a1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:10.932857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-6cc8a542-ffb8-4cca-af9e-588fb593a1ad None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:10.934095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6cc8a542-ffb8-4cca-af9e-588fb593a1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:10.986033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae938ed4-8d5d-4c11-be5a-af6285ae3890 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:11.021406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 155/307] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:11.022331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8a542-ffb8-4cca-af9e-588fb593a1ad None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:11.042459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318df69-03ea-4fa5-b84d-ef1e10d56397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:11.044007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318df69-03ea-4fa5-b84d-ef1e10d56397 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:11.044529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318df69-03ea-4fa5-b84d-ef1e10d56397 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:11.045023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318df69-03ea-4fa5-b84d-ef1e10d56397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:11.046638 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318df69-03ea-4fa5-b84d-ef1e10d56397 None admin] RBAC: Adding query filter params (role.id=ef402940c145454090aa4eba58af85bf, user.id=4246b99f33614dc28772038f56467e55, scope.system=all) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:11.047190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318df69-03ea-4fa5-b84d-ef1e10d56397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:11.049897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318df69-03ea-4fa5-b84d-ef1e10d56397 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:11.060058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 153/308] 10.222.0.59 () {56 vars in 1308 bytes} [Thu May 12 20:17:10 2022] GET /identity/v3/role_assignments?user.id=4246b99f33614dc28772038f56467e55&scope.system=all&role.id=ef402940c145454090aa4eba58af85bf => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:11.061556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318df69-03ea-4fa5-b84d-ef1e10d56397 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:11.167883 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8a542-ffb8-4cca-af9e-588fb593a1ad None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:11.189974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318df69-03ea-4fa5-b84d-ef1e10d56397 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:11.224015 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b668e6-54cb-41ac-a513-61063d1aa539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:11.225789 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b668e6-54cb-41ac-a513-61063d1aa539 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:11.226564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b668e6-54cb-41ac-a513-61063d1aa539 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:11.227044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b668e6-54cb-41ac-a513-61063d1aa539 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:11.231186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b276d6f-fdf1-4a1e-9872-a0e46894771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:11.231954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b276d6f-fdf1-4a1e-9872-a0e46894771c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:11.232486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b276d6f-fdf1-4a1e-9872-a0e46894771c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:11.232856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b276d6f-fdf1-4a1e-9872-a0e46894771c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:11.242430 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b668e6-54cb-41ac-a513-61063d1aa539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:11.247026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b276d6f-fdf1-4a1e-9872-a0e46894771c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9b276d6f-fdf1-4a1e-9872-a0e46894771c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:11.254981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:11.255972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:11.256761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 154/309] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-41b668e6-54cb-41ac-a513-61063d1aa539 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:11.258160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:11.259260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:11.260057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:11.262628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b276d6f-fdf1-4a1e-9872-a0e46894771c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:11.263079 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 156/310] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:11.269846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b668e6-54cb-41ac-a513-61063d1aa539 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:11.390773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b668e6-54cb-41ac-a513-61063d1aa539 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:11.432461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b276d6f-fdf1-4a1e-9872-a0e46894771c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:11.443490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d7207-c3cf-4b5b-bb9d-21af6580a674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:11.444776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d7207-c3cf-4b5b-bb9d-21af6580a674 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:11.445538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d7207-c3cf-4b5b-bb9d-21af6580a674 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:11.446051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d7207-c3cf-4b5b-bb9d-21af6580a674 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:11.446994 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d7207-c3cf-4b5b-bb9d-21af6580a674 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:11.447617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d7207-c3cf-4b5b-bb9d-21af6580a674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:11.449913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d7207-c3cf-4b5b-bb9d-21af6580a674 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:11.466942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 157/311] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:11.469617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d7207-c3cf-4b5b-bb9d-21af6580a674 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:11.476563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9138b9-bd1f-40e6-a750-b552c676ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:11.478246 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9138b9-bd1f-40e6-a750-b552c676ae35 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:11.478888 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9138b9-bd1f-40e6-a750-b552c676ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:11.479313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9138b9-bd1f-40e6-a750-b552c676ae35 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:11.480230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9138b9-bd1f-40e6-a750-b552c676ae35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:11.480739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9138b9-bd1f-40e6-a750-b552c676ae35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:11.483000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9138b9-bd1f-40e6-a750-b552c676ae35 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:11.500475 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 155/312] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:11.502334 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9138b9-bd1f-40e6-a750-b552c676ae35 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:11.595255 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d7207-c3cf-4b5b-bb9d-21af6580a674 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:11.631845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9138b9-bd1f-40e6-a750-b552c676ae35 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:11.638663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48552a-dd71-45ef-ad32-53819fe0ba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:11.639888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48552a-dd71-45ef-ad32-53819fe0ba2e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:11.640370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48552a-dd71-45ef-ad32-53819fe0ba2e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:11.641358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48552a-dd71-45ef-ad32-53819fe0ba2e None admin] PATH_INFO: `/v3/users/25459429177e4a1db2543a55fa9c115e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:11.643248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48552a-dd71-45ef-ad32-53819fe0ba2e None admin] RBAC: Authorizing `identity:get_user(user_id=25459429177e4a1db2543a55fa9c115e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:11.645449 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48552a-dd71-45ef-ad32-53819fe0ba2e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:11.653154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 158/313] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:11 2022] GET /identity/v3/users/25459429177e4a1db2543a55fa9c115e => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:11.654941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48552a-dd71-45ef-ad32-53819fe0ba2e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:11.679222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc01a6-3363-4eb5-bfc4-6a84b40f0be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:11.680317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc01a6-3363-4eb5-bfc4-6a84b40f0be0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:11.680687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc01a6-3363-4eb5-bfc4-6a84b40f0be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:11.680975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc01a6-3363-4eb5-bfc4-6a84b40f0be0 None admin] PATH_INFO: `/v3/users/59f7165511d449799dc34703b2fdd2d4` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:11.682933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc01a6-3363-4eb5-bfc4-6a84b40f0be0 None admin] RBAC: Authorizing `identity:get_user(user_id=59f7165511d449799dc34703b2fdd2d4)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:11.684740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc01a6-3363-4eb5-bfc4-6a84b40f0be0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:11.687158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 156/314] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:11 2022] GET /identity/v3/users/59f7165511d449799dc34703b2fdd2d4 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:11.692677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc01a6-3363-4eb5-bfc4-6a84b40f0be0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:11.787648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48552a-dd71-45ef-ad32-53819fe0ba2e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:11.809045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc01a6-3363-4eb5-bfc4-6a84b40f0be0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:11.832761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806d644-8b92-41d4-bf5b-2fedc6a3631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:11.833603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806d644-8b92-41d4-bf5b-2fedc6a3631b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:11.833897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806d644-8b92-41d4-bf5b-2fedc6a3631b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:11.834179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806d644-8b92-41d4-bf5b-2fedc6a3631b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:11.847096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2a8e7-b3a6-4728-bf15-ee35bcc1d8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:11.848309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2a8e7-b3a6-4728-bf15-ee35bcc1d8dc None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:11.848787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2a8e7-b3a6-4728-bf15-ee35bcc1d8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:11.849304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2a8e7-b3a6-4728-bf15-ee35bcc1d8dc None admin] PATH_INFO: `/v3/system/users/59f7165511d449799dc34703b2fdd2d4/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:11.851009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2a8e7-b3a6-4728-bf15-ee35bcc1d8dc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=59f7165511d449799dc34703b2fdd2d4, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:11.852621 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2a8e7-b3a6-4728-bf15-ee35bcc1d8dc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:11.916615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806d644-8b92-41d4-bf5b-2fedc6a3631b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:11.919173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806d644-8b92-41d4-bf5b-2fedc6a3631b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:11.955680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 157/315] 10.222.0.59 () {58 vars in 1334 bytes} [Thu May 12 20:17:11 2022] PUT /identity/v3/system/users/59f7165511d449799dc34703b2fdd2d4/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:17:12.053489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 159/316] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 20:17:12.060380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2a8e7-b3a6-4728-bf15-ee35bcc1d8dc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:12.184262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2a8e7-b3a6-4728-bf15-ee35bcc1d8dc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:12.227397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f85c9-e37c-43d6-a541-956c38f10ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:12.228872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f85c9-e37c-43d6-a541-956c38f10ace None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:12.229158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f85c9-e37c-43d6-a541-956c38f10ace None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:12.229467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f85c9-e37c-43d6-a541-956c38f10ace None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:12.230673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f85c9-e37c-43d6-a541-956c38f10ace None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:12.232367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f85c9-e37c-43d6-a541-956c38f10ace None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:12.234271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 158/317] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:12 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:12.240407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806d644-8b92-41d4-bf5b-2fedc6a3631b None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:12.350692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806d644-8b92-41d4-bf5b-2fedc6a3631b None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:12.387282 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c9741-1cf3-4f4d-85fa-66448b9fd923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:12.387957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c9741-1cf3-4f4d-85fa-66448b9fd923 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:12.388388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c9741-1cf3-4f4d-85fa-66448b9fd923 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:12.388741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c9741-1cf3-4f4d-85fa-66448b9fd923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:12.389639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c9741-1cf3-4f4d-85fa-66448b9fd923 None admin] RBAC: Adding query filter params (role.id=ef402940c145454090aa4eba58af85bf, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598, user.id=25459429177e4a1db2543a55fa9c115e) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:12.389952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c9741-1cf3-4f4d-85fa-66448b9fd923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:12.391418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c9741-1cf3-4f4d-85fa-66448b9fd923 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:12.398982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 160/318] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:12 2022] GET /identity/v3/role_assignments?user.id=25459429177e4a1db2543a55fa9c115e&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=ef402940c145454090aa4eba58af85bf => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:13.037557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41746-0dd4-4f37-bb31-7c84290e3034 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:13.038083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41746-0dd4-4f37-bb31-7c84290e3034 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:13.038083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41746-0dd4-4f37-bb31-7c84290e3034 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:13.039692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 159/319] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:13.045361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18f215-5944-4bcb-8e68-e0a3fa3b1ad6 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:13.045661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18f215-5944-4bcb-8e68-e0a3fa3b1ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:13.045946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18f215-5944-4bcb-8e68-e0a3fa3b1ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:13.063407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-9b18f215-5944-4bcb-8e68-e0a3fa3b1ad6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:13.064590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9b18f215-5944-4bcb-8e68-e0a3fa3b1ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:13.133941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 161/320] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:13.156513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be41746-0dd4-4f37-bb31-7c84290e3034 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:13.261629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be41746-0dd4-4f37-bb31-7c84290e3034 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:13.295902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e212c9-caa6-47d5-8fe9-add6175262a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:13.296727 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e212c9-caa6-47d5-8fe9-add6175262a2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:13.297011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e212c9-caa6-47d5-8fe9-add6175262a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:13.297310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e212c9-caa6-47d5-8fe9-add6175262a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:13.298777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e212c9-caa6-47d5-8fe9-add6175262a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:13.300216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e212c9-caa6-47d5-8fe9-add6175262a2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:13.302188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 160/321] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:13.308087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18f215-5944-4bcb-8e68-e0a3fa3b1ad6 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:13.408498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18f215-5944-4bcb-8e68-e0a3fa3b1ad6 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:13.444092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4443267-2f3e-420b-98dc-acfb586938f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:13.444772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4443267-2f3e-420b-98dc-acfb586938f3 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:13.445063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4443267-2f3e-420b-98dc-acfb586938f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:13.445373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4443267-2f3e-420b-98dc-acfb586938f3 None admin] PATH_INFO: `/v3/groups` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:13.446827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4443267-2f3e-420b-98dc-acfb586938f3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:13.448297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4443267-2f3e-420b-98dc-acfb586938f3 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:13.489530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b211-af65-4453-a75b-324fdc3b08e5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:13.489825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b211-af65-4453-a75b-324fdc3b08e5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:13.490103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b211-af65-4453-a75b-324fdc3b08e5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:13.493401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 161/322] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:17:13.498367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e562b-f014-4537-8884-8b9823c2ae65 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:13.498658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e562b-f014-4537-8884-8b9823c2ae65 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:13.498947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e562b-f014-4537-8884-8b9823c2ae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:13.524958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0c8e562b-f014-4537-8884-8b9823c2ae65 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:13.526275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0c8e562b-f014-4537-8884-8b9823c2ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:13.571704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 162/323] 10.222.0.59 () {60 vars in 1134 bytes} [Thu May 12 20:17:13 2022] POST /identity/v3/groups => generated 226 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:17:13.601321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 162/324] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:13.621115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4443267-2f3e-420b-98dc-acfb586938f3 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:13.782867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4443267-2f3e-420b-98dc-acfb586938f3 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:13.819300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabc66-cf54-4de3-9545-7a6facad7f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:13.820469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabc66-cf54-4de3-9545-7a6facad7f40 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:13.820980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabc66-cf54-4de3-9545-7a6facad7f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:13.822130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eabc66-cf54-4de3-9545-7a6facad7f40 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:13.834834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eabc66-cf54-4de3-9545-7a6facad7f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-c3eabc66-cf54-4de3-9545-7a6facad7f40 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:13.842910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:13.843810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:13.844612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:13.846737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 163/325] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:13.853117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e562b-f014-4537-8884-8b9823c2ae65 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:13.967445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e562b-f014-4537-8884-8b9823c2ae65 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:14.006931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d3c35-b075-4819-a50f-9d4f7e4f9c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:14.007622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d3c35-b075-4819-a50f-9d4f7e4f9c94 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:14.007910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d3c35-b075-4819-a50f-9d4f7e4f9c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:14.008190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d3c35-b075-4819-a50f-9d4f7e4f9c94 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:14.009000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d3c35-b075-4819-a50f-9d4f7e4f9c94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:14.009431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d3c35-b075-4819-a50f-9d4f7e4f9c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:14.010739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d3c35-b075-4819-a50f-9d4f7e4f9c94 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:14.022196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 163/326] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:14.027531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabc66-cf54-4de3-9545-7a6facad7f40 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:14.170326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eabc66-cf54-4de3-9545-7a6facad7f40 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:14.212885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13f3f-e1d2-4165-98a9-f30775b26c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:14.213801 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13f3f-e1d2-4165-98a9-f30775b26c21 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:14.214088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13f3f-e1d2-4165-98a9-f30775b26c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:14.214365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13f3f-e1d2-4165-98a9-f30775b26c21 None admin] PATH_INFO: `/v3/users/4246b99f33614dc28772038f56467e55` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:14.215575 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13f3f-e1d2-4165-98a9-f30775b26c21 None admin] RBAC: Authorizing `identity:get_user(user_id=4246b99f33614dc28772038f56467e55)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:14.217024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13f3f-e1d2-4165-98a9-f30775b26c21 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:14.219035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 164/327] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:14 2022] GET /identity/v3/users/4246b99f33614dc28772038f56467e55 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:14.224272 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d3c35-b075-4819-a50f-9d4f7e4f9c94 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:14.360663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffb3f3-a13c-47d2-abf7-1a9039b56963 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:14.360663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffb3f3-a13c-47d2-abf7-1a9039b56963 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:14.360663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffb3f3-a13c-47d2-abf7-1a9039b56963 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:14.364979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 165/328] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:14.368753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db044d-739d-4600-9cf5-1a7879934d90 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:14.368753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db044d-739d-4600-9cf5-1a7879934d90 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:14.368753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db044d-739d-4600-9cf5-1a7879934d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:14.384902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d3c35-b075-4819-a50f-9d4f7e4f9c94 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:14.389114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a1db044d-739d-4600-9cf5-1a7879934d90 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:14.392973 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a1db044d-739d-4600-9cf5-1a7879934d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:14.436179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819f1cf-5939-41da-ab60-2d5c5930c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:14.437050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819f1cf-5939-41da-ab60-2d5c5930c5a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:14.437394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819f1cf-5939-41da-ab60-2d5c5930c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:14.437645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819f1cf-5939-41da-ab60-2d5c5930c5a8 None admin] PATH_INFO: `/v3/system/users/4246b99f33614dc28772038f56467e55/roles/ef402940c145454090aa4eba58af85bf` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:14.442171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819f1cf-5939-41da-ab60-2d5c5930c5a8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4246b99f33614dc28772038f56467e55, role_id=ef402940c145454090aa4eba58af85bf)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:14.443599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819f1cf-5939-41da-ab60-2d5c5930c5a8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:14.481506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 166/329] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:14.505779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db044d-739d-4600-9cf5-1a7879934d90 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:14.521506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 164/330] 10.222.0.59 () {58 vars in 1334 bytes} [Thu May 12 20:17:14 2022] PUT /identity/v3/system/users/4246b99f33614dc28772038f56467e55/roles/ef402940c145454090aa4eba58af85bf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:14.638833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db044d-739d-4600-9cf5-1a7879934d90 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:14.685040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876d8db-126c-42a0-a845-6c850fab164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:14.685943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876d8db-126c-42a0-a845-6c850fab164d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:14.686339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876d8db-126c-42a0-a845-6c850fab164d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:14.686572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876d8db-126c-42a0-a845-6c850fab164d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:14.699755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876d8db-126c-42a0-a845-6c850fab164d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-2876d8db-126c-42a0-a845-6c850fab164d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:14.712529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:14.713680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:14.714504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 167/331] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:14.721358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819f1cf-5939-41da-ab60-2d5c5930c5a8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:14.909551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819f1cf-5939-41da-ab60-2d5c5930c5a8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:14.953121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb989dc-a784-4cd5-b7d5-7959d5ac2b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:14.954213 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb989dc-a784-4cd5-b7d5-7959d5ac2b27 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:14.954754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb989dc-a784-4cd5-b7d5-7959d5ac2b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:14.955239 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb989dc-a784-4cd5-b7d5-7959d5ac2b27 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:14.956183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb989dc-a784-4cd5-b7d5-7959d5ac2b27 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:14.956681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb989dc-a784-4cd5-b7d5-7959d5ac2b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:14.958290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb989dc-a784-4cd5-b7d5-7959d5ac2b27 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:14.969607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 165/332] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:14.976158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876d8db-126c-42a0-a845-6c850fab164d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:15.178322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876d8db-126c-42a0-a845-6c850fab164d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:15.216745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafad478-6217-4bd7-b0e7-b495c78a465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:15.217570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafad478-6217-4bd7-b0e7-b495c78a465e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:15.217853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafad478-6217-4bd7-b0e7-b495c78a465e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:15.218128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafad478-6217-4bd7-b0e7-b495c78a465e None admin] PATH_INFO: `/v3/users/59f7165511d449799dc34703b2fdd2d4` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:15.219330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafad478-6217-4bd7-b0e7-b495c78a465e None admin] RBAC: Authorizing `identity:get_user(user_id=59f7165511d449799dc34703b2fdd2d4)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:15.220772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafad478-6217-4bd7-b0e7-b495c78a465e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:15.222751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 168/333] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:14 2022] GET /identity/v3/users/59f7165511d449799dc34703b2fdd2d4 => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:15.229463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb989dc-a784-4cd5-b7d5-7959d5ac2b27 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:15.373927 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb989dc-a784-4cd5-b7d5-7959d5ac2b27 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:15.412894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544ab38-3508-4124-96eb-0451e19a05d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:15.413929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544ab38-3508-4124-96eb-0451e19a05d8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:15.414427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544ab38-3508-4124-96eb-0451e19a05d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:15.414943 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544ab38-3508-4124-96eb-0451e19a05d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:15.416261 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544ab38-3508-4124-96eb-0451e19a05d8 None admin] RBAC: Adding query filter params (role.id=4982f0e43bc8430d81d3906431eff62e, user.id=59f7165511d449799dc34703b2fdd2d4, scope.system=all) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:15.416809 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544ab38-3508-4124-96eb-0451e19a05d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:15.418461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544ab38-3508-4124-96eb-0451e19a05d8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:15.436401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 166/334] 10.222.0.59 () {56 vars in 1308 bytes} [Thu May 12 20:17:15 2022] GET /identity/v3/role_assignments?user.id=59f7165511d449799dc34703b2fdd2d4&scope.system=all&role.id=4982f0e43bc8430d81d3906431eff62e => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:16.570563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15682f0-f1dd-424b-9428-b9c9d584856a None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:16.571935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15682f0-f1dd-424b-9428-b9c9d584856a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:16.571935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15682f0-f1dd-424b-9428-b9c9d584856a None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:16.573425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 169/335] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:16.591060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282569ab-b59c-4b71-a2bf-4aa323505ab0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:16.591842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282569ab-b59c-4b71-a2bf-4aa323505ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:16.591842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282569ab-b59c-4b71-a2bf-4aa323505ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:16.608990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-282569ab-b59c-4b71-a2bf-4aa323505ab0 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:16.610244 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-282569ab-b59c-4b71-a2bf-4aa323505ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:16.695508 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 167/336] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:16.743651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15682f0-f1dd-424b-9428-b9c9d584856a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:16.865180 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15682f0-f1dd-424b-9428-b9c9d584856a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:16.922179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bf088-83f4-429f-99f3-0d6eeb263209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:16.923372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bf088-83f4-429f-99f3-0d6eeb263209 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:16.923878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bf088-83f4-429f-99f3-0d6eeb263209 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:16.924353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bf088-83f4-429f-99f3-0d6eeb263209 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:16.942349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bf088-83f4-429f-99f3-0d6eeb263209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-022bf088-83f4-429f-99f3-0d6eeb263209 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:16.952834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:16.954414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:16.955746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:16.960062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 170/337] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:16.965562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282569ab-b59c-4b71-a2bf-4aa323505ab0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:17.098656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282569ab-b59c-4b71-a2bf-4aa323505ab0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:17.140482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a1dc6-0892-46d6-928b-7e8e89f008c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:17.141089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a1dc6-0892-46d6-928b-7e8e89f008c6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:17.141403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a1dc6-0892-46d6-928b-7e8e89f008c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:17.141684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a1dc6-0892-46d6-928b-7e8e89f008c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:17.142443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a1dc6-0892-46d6-928b-7e8e89f008c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:17.142751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a1dc6-0892-46d6-928b-7e8e89f008c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:17.144132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a1dc6-0892-46d6-928b-7e8e89f008c6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:17.154275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 168/338] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:17.159456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bf088-83f4-429f-99f3-0d6eeb263209 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:17.314931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bf088-83f4-429f-99f3-0d6eeb263209 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:17.368655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63add2-a9f6-416e-b90e-5c8617c5eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:17.369617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63add2-a9f6-416e-b90e-5c8617c5eddf None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:17.369906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63add2-a9f6-416e-b90e-5c8617c5eddf None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:17.370181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63add2-a9f6-416e-b90e-5c8617c5eddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:17.456847 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63add2-a9f6-416e-b90e-5c8617c5eddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:17.458293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63add2-a9f6-416e-b90e-5c8617c5eddf None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:17.507260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86427e-673b-47bf-9257-b0a0f7927c48 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:17.507587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86427e-673b-47bf-9257-b0a0f7927c48 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:17.507820 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86427e-673b-47bf-9257-b0a0f7927c48 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:17.510082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 169/339] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:17:17.516633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beebf45-27c7-4fcb-9fb5-d694364e1b54 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:17.517246 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beebf45-27c7-4fcb-9fb5-d694364e1b54 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:17.517773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beebf45-27c7-4fcb-9fb5-d694364e1b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:17.553560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2beebf45-27c7-4fcb-9fb5-d694364e1b54 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:17.555117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2beebf45-27c7-4fcb-9fb5-d694364e1b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:17.596909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 171/340] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:17.602132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63add2-a9f6-416e-b90e-5c8617c5eddf None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:17.705742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 170/341] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:17.759920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beebf45-27c7-4fcb-9fb5-d694364e1b54 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:17.784645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63add2-a9f6-416e-b90e-5c8617c5eddf None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:17.851209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b96be-81bd-40f9-b762-464b76839be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:17.853121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b96be-81bd-40f9-b762-464b76839be4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:17.853648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b96be-81bd-40f9-b762-464b76839be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:17.854148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b96be-81bd-40f9-b762-464b76839be4 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:17.858189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b96be-81bd-40f9-b762-464b76839be4 None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:17.860075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b96be-81bd-40f9-b762-464b76839be4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:17.863985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 172/342] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:17 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:17.870641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b96be-81bd-40f9-b762-464b76839be4 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:17.975622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beebf45-27c7-4fcb-9fb5-d694364e1b54 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:18.003623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b96be-81bd-40f9-b762-464b76839be4 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:18.034170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa40b4-2919-4e7d-8b7b-1db6f55afac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:18.034923 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa40b4-2919-4e7d-8b7b-1db6f55afac9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.035202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa40b4-2919-4e7d-8b7b-1db6f55afac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.035477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa40b4-2919-4e7d-8b7b-1db6f55afac9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.048142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c69f24-97e5-4c43-ad7d-1c7bc064919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:18.049018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69f24-97e5-4c43-ad7d-1c7bc064919e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.049317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69f24-97e5-4c43-ad7d-1c7bc064919e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.049599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69f24-97e5-4c43-ad7d-1c7bc064919e None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.053396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa40b4-2919-4e7d-8b7b-1db6f55afac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-46fa40b4-2919-4e7d-8b7b-1db6f55afac9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:18.062312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:18.063352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:18.064674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:18.065307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c69f24-97e5-4c43-ad7d-1c7bc064919e None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:18.065386 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 171/343] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:17:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:18.065462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c69f24-97e5-4c43-ad7d-1c7bc064919e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:18.065530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9121a-2af5-4c39-9534-4ff76042d702 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.065530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9121a-2af5-4c39-9534-4ff76042d702 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.065952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9121a-2af5-4c39-9534-4ff76042d702 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.067104 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 173/344] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:17 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:18.067858 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 172/345] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:18.073125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786c8bd-13a4-47be-b5c1-8e3fee309be4 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.073397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9121a-2af5-4c39-9534-4ff76042d702 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:18.073585 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786c8bd-13a4-47be-b5c1-8e3fee309be4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.073760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786c8bd-13a4-47be-b5c1-8e3fee309be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.106419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-1786c8bd-13a4-47be-b5c1-8e3fee309be4 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:18.107637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1786c8bd-13a4-47be-b5c1-8e3fee309be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:18.196143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 174/346] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:18.197224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786c8bd-13a4-47be-b5c1-8e3fee309be4 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:18.210096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9121a-2af5-4c39-9534-4ff76042d702 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:18.269391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4362-ee60-48e6-9fda-63da92b605fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:18.270093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4362-ee60-48e6-9fda-63da92b605fc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.270378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4362-ee60-48e6-9fda-63da92b605fc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.270653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4362-ee60-48e6-9fda-63da92b605fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.271498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4362-ee60-48e6-9fda-63da92b605fc None admin] RBAC: Adding query filter params (group.id=da86f25140dd4e8490302ac941bf3de6, role.id=4982f0e43bc8430d81d3906431eff62e, scope.project.id=1a986d55348f4996bbf49674a39f2e34) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:18.271808 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4362-ee60-48e6-9fda-63da92b605fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:18.273292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4362-ee60-48e6-9fda-63da92b605fc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:18.280838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 173/347] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 12 20:17:18 2022] GET /identity/v3/role_assignments?group.id=da86f25140dd4e8490302ac941bf3de6&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=4982f0e43bc8430d81d3906431eff62e => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:18.283064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4362-ee60-48e6-9fda-63da92b605fc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:18.327628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786c8bd-13a4-47be-b5c1-8e3fee309be4 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:18.373395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8d84d-9eed-4ecf-a05f-df54828f4a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:18.374087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8d84d-9eed-4ecf-a05f-df54828f4a49 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.374371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8d84d-9eed-4ecf-a05f-df54828f4a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.374646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8d84d-9eed-4ecf-a05f-df54828f4a49 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.375414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8d84d-9eed-4ecf-a05f-df54828f4a49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:18.375721 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8d84d-9eed-4ecf-a05f-df54828f4a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:18.377105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8d84d-9eed-4ecf-a05f-df54828f4a49 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:18.386990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 175/348] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:18.392850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8d84d-9eed-4ecf-a05f-df54828f4a49 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:18.397641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4362-ee60-48e6-9fda-63da92b605fc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:18.441463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc2866-ad72-40f3-83d1-c035d13e9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:18.443960 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2866-ad72-40f3-83d1-c035d13e9603 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.445563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2866-ad72-40f3-83d1-c035d13e9603 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.449295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2866-ad72-40f3-83d1-c035d13e9603 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.470268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc2866-ad72-40f3-83d1-c035d13e9603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-50cc2866-ad72-40f3-83d1-c035d13e9603 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:18.483996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:18.484981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:18.485829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:18.489162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 174/349] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:18.493926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450ab3-2aa4-4868-9c2d-9105865d4669 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.495443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450ab3-2aa4-4868-9c2d-9105865d4669 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.497349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450ab3-2aa4-4868-9c2d-9105865d4669 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.499141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 175/350] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:18.507479 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa450ab3-2aa4-4868-9c2d-9105865d4669 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:18.624988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8d84d-9eed-4ecf-a05f-df54828f4a49 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:18.674320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b8551-6166-433f-bd5b-491946d79e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:18.674993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b8551-6166-433f-bd5b-491946d79e2b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.675276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b8551-6166-433f-bd5b-491946d79e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.675549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b8551-6166-433f-bd5b-491946d79e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.683181 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa450ab3-2aa4-4868-9c2d-9105865d4669 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:18.721690 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7f43a-713e-4f5d-815e-3d98bc684ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:18.722475 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7f43a-713e-4f5d-815e-3d98bc684ddb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.722750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7f43a-713e-4f5d-815e-3d98bc684ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.723034 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7f43a-713e-4f5d-815e-3d98bc684ddb None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.723814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7f43a-713e-4f5d-815e-3d98bc684ddb None admin] RBAC: Adding query filter params (name=member) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:18.724125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7f43a-713e-4f5d-815e-3d98bc684ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:18.725586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7f43a-713e-4f5d-815e-3d98bc684ddb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:18.735684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 176/351] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:18.737053 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55cdc9-a1a8-4113-b9b4-21c784668616 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.737365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55cdc9-a1a8-4113-b9b4-21c784668616 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.737709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55cdc9-a1a8-4113-b9b4-21c784668616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.755493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b8551-6166-433f-bd5b-491946d79e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:18.756978 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b8551-6166-433f-bd5b-491946d79e2b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:18.761930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9e55cdc9-a1a8-4113-b9b4-21c784668616 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:18.763133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9e55cdc9-a1a8-4113-b9b4-21c784668616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:18.838642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 177/352] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:18.839514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55cdc9-a1a8-4113-b9b4-21c784668616 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:18.875772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 176/353] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 20:17:18.877075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a9656-7e1e-4acf-bd47-dd45e0f3d6a2 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.877391 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a9656-7e1e-4acf-bd47-dd45e0f3d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.877677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a9656-7e1e-4acf-bd47-dd45e0f3d6a2 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:18.879005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 177/354] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:18.879734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a9656-7e1e-4acf-bd47-dd45e0f3d6a2 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:18.948842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55cdc9-a1a8-4113-b9b4-21c784668616 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:18.988193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3781442-d9bc-46f4-a955-7694b876a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:18.988863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3781442-d9bc-46f4-a955-7694b876a48d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:18.989148 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3781442-d9bc-46f4-a955-7694b876a48d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:18.989453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3781442-d9bc-46f4-a955-7694b876a48d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.007068 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a9656-7e1e-4acf-bd47-dd45e0f3d6a2 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:19.049225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd198114-8d95-4699-bb73-ecb14dc70bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:19.050097 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198114-8d95-4699-bb73-ecb14dc70bdb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:19.050381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198114-8d95-4699-bb73-ecb14dc70bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:19.050659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198114-8d95-4699-bb73-ecb14dc70bdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.068202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3781442-d9bc-46f4-a955-7694b876a48d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:19.069554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd198114-8d95-4699-bb73-ecb14dc70bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:19.069889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3781442-d9bc-46f4-a955-7694b876a48d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-fd198114-8d95-4699-bb73-ecb14dc70bdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:19.078108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:19.079127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 178/355] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:17:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:19.080372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd198114-8d95-4699-bb73-ecb14dc70bdb None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:19.182924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 178/356] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:19.184190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0a61-860c-4709-9591-89da5cc21d0f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:19.184485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0a61-860c-4709-9591-89da5cc21d0f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:19.184761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba0a61-860c-4709-9591-89da5cc21d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.208019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-74ba0a61-860c-4709-9591-89da5cc21d0f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:19.209218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-74ba0a61-860c-4709-9591-89da5cc21d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:19.226698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd198114-8d95-4699-bb73-ecb14dc70bdb None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:19.279154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef47ff-3b9a-40cd-ad4c-a1196ddfcffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:19.280440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef47ff-3b9a-40cd-ad4c-a1196ddfcffe None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:19.280787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef47ff-3b9a-40cd-ad4c-a1196ddfcffe None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:19.281071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef47ff-3b9a-40cd-ad4c-a1196ddfcffe None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.284357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef47ff-3b9a-40cd-ad4c-a1196ddfcffe None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:19.286549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef47ff-3b9a-40cd-ad4c-a1196ddfcffe None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:19.294982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 179/357] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:19 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:19.294982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef47ff-3b9a-40cd-ad4c-a1196ddfcffe None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:19.303528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 179/358] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:19.304581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba0a61-860c-4709-9591-89da5cc21d0f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:19.433447 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef47ff-3b9a-40cd-ad4c-a1196ddfcffe None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:19.446003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba0a61-860c-4709-9591-89da5cc21d0f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:19.479140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb59135-30c2-4cc8-bb19-132767c4990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:19.479833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb59135-30c2-4cc8-bb19-132767c4990f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:19.480121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb59135-30c2-4cc8-bb19-132767c4990f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:19.480400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb59135-30c2-4cc8-bb19-132767c4990f None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.481170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb59135-30c2-4cc8-bb19-132767c4990f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:19.481581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb59135-30c2-4cc8-bb19-132767c4990f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:19.483002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb59135-30c2-4cc8-bb19-132767c4990f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:19.492456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 180/359] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:19.492669 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f9938-3949-4407-b1ae-43ced450f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:19.494623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f9938-3949-4407-b1ae-43ced450f9aa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:19.494623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f9938-3949-4407-b1ae-43ced450f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:19.494816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed71b68-ba14-43d9-a209-545c803a705a None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:19.494888 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f9938-3949-4407-b1ae-43ced450f9aa None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.494969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed71b68-ba14-43d9-a209-545c803a705a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:19.494969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed71b68-ba14-43d9-a209-545c803a705a None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.495483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f9938-3949-4407-b1ae-43ced450f9aa None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:19.496937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f9938-3949-4407-b1ae-43ced450f9aa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:19.498897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 180/360] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:19 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:19.499250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 181/361] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:19.499676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f9938-3949-4407-b1ae-43ced450f9aa None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:19.500589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed71b68-ba14-43d9-a209-545c803a705a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:19.632687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f9938-3949-4407-b1ae-43ced450f9aa None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:19.641965 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed71b68-ba14-43d9-a209-545c803a705a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:19.675167 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbfea1-3459-4886-bbb4-34847090ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:19.676168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbfea1-3459-4886-bbb4-34847090ce10 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:19.676549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbfea1-3459-4886-bbb4-34847090ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:19.676883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbfea1-3459-4886-bbb4-34847090ce10 None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.678172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbfea1-3459-4886-bbb4-34847090ce10 None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:19.679652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbfea1-3459-4886-bbb4-34847090ce10 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:19.682967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 181/362] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:19 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:19.683838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbfea1-3459-4886-bbb4-34847090ce10 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:19.691850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20688ba5-6f87-4a8e-9d61-c8554f7b7bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:19.692977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20688ba5-6f87-4a8e-9d61-c8554f7b7bed None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:19.693927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20688ba5-6f87-4a8e-9d61-c8554f7b7bed None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:19.694357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20688ba5-6f87-4a8e-9d61-c8554f7b7bed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.708264 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20688ba5-6f87-4a8e-9d61-c8554f7b7bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-20688ba5-6f87-4a8e-9d61-c8554f7b7bed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:19.716700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:19.718182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:19.719000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 182/363] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:19.719703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c46df-bf46-48ad-9c50-df7c9bca0340 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:19.719703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c46df-bf46-48ad-9c50-df7c9bca0340 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:19.719838 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c46df-bf46-48ad-9c50-df7c9bca0340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.743885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-652c46df-bf46-48ad-9c50-df7c9bca0340 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:19.745799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-652c46df-bf46-48ad-9c50-df7c9bca0340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:19.836438 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbfea1-3459-4886-bbb4-34847090ce10 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:19.849390 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 183/364] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:19.850114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c46df-bf46-48ad-9c50-df7c9bca0340 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:19.880208 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae09bd-30f7-4454-825a-c14148b0a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:19.881108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae09bd-30f7-4454-825a-c14148b0a3ea None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:19.881582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae09bd-30f7-4454-825a-c14148b0a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:19.882001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae09bd-30f7-4454-825a-c14148b0a3ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:19.967056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae09bd-30f7-4454-825a-c14148b0a3ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:19.968680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae09bd-30f7-4454-825a-c14148b0a3ea None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:19.986579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c46df-bf46-48ad-9c50-df7c9bca0340 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:20.041314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffe2ae-9bf1-4db0-969c-bff4158d530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:20.041536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffe2ae-9bf1-4db0-969c-bff4158d530a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:20.041735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffe2ae-9bf1-4db0-969c-bff4158d530a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:20.042011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffe2ae-9bf1-4db0-969c-bff4158d530a None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:20.043637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffe2ae-9bf1-4db0-969c-bff4158d530a None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:20.044667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffe2ae-9bf1-4db0-969c-bff4158d530a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:20.046392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 184/365] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:19 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:20.047319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffe2ae-9bf1-4db0-969c-bff4158d530a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:20.103089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 182/366] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:20.103987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae09bd-30f7-4454-825a-c14148b0a3ea None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:20.190677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffe2ae-9bf1-4db0-969c-bff4158d530a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:20.251084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae09bd-30f7-4454-825a-c14148b0a3ea None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:20.266083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb0c4a-4a0a-49bb-9155-a65462e801cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:20.266771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb0c4a-4a0a-49bb-9155-a65462e801cd None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:20.267055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb0c4a-4a0a-49bb-9155-a65462e801cd None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:20.267336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb0c4a-4a0a-49bb-9155-a65462e801cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:20.268181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb0c4a-4a0a-49bb-9155-a65462e801cd None admin] RBAC: Adding query filter params (group.id=da86f25140dd4e8490302ac941bf3de6, role.id=2f9013fc95d448a5b605f539fb6ae08f, scope.project.id=1a986d55348f4996bbf49674a39f2e34) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:20.268495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb0c4a-4a0a-49bb-9155-a65462e801cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:20.269959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb0c4a-4a0a-49bb-9155-a65462e801cd None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:20.277304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 185/367] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 12 20:17:20 2022] GET /identity/v3/role_assignments?group.id=da86f25140dd4e8490302ac941bf3de6&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=2f9013fc95d448a5b605f539fb6ae08f => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:20.278146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb0c4a-4a0a-49bb-9155-a65462e801cd None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:20.376862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e1456-40bf-4388-bbac-4cfef2e6f485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:20.377605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e1456-40bf-4388-bbac-4cfef2e6f485 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:20.377891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e1456-40bf-4388-bbac-4cfef2e6f485 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:20.378170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e1456-40bf-4388-bbac-4cfef2e6f485 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:20.378941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e1456-40bf-4388-bbac-4cfef2e6f485 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:20.379247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e1456-40bf-4388-bbac-4cfef2e6f485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:20.380635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e1456-40bf-4388-bbac-4cfef2e6f485 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:20.414193 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb0c4a-4a0a-49bb-9155-a65462e801cd None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:20.419810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 183/368] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:20.421752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e1456-40bf-4388-bbac-4cfef2e6f485 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:20.476653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e23f-5b45-4b9c-81c6-d0355a5e1c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:20.478553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e23f-5b45-4b9c-81c6-d0355a5e1c82 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:20.479389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e23f-5b45-4b9c-81c6-d0355a5e1c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:20.479692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e23f-5b45-4b9c-81c6-d0355a5e1c82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:20.503660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62e23f-5b45-4b9c-81c6-d0355a5e1c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-0a62e23f-5b45-4b9c-81c6-d0355a5e1c82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:20.516895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:20.517885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:17:20.518662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:20.522746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 186/369] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:20.526764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e23f-5b45-4b9c-81c6-d0355a5e1c82 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:20.650813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e1456-40bf-4388-bbac-4cfef2e6f485 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:20.681813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e23f-5b45-4b9c-81c6-d0355a5e1c82 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:20.718572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0f2d2-6428-4fd0-a37e-faa3b1811343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:20.719331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0f2d2-6428-4fd0-a37e-faa3b1811343 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:20.719331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0f2d2-6428-4fd0-a37e-faa3b1811343 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:20.719634 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0f2d2-6428-4fd0-a37e-faa3b1811343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:20.720923 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0f2d2-6428-4fd0-a37e-faa3b1811343 None admin] RBAC: Adding query filter params (group.id=da86f25140dd4e8490302ac941bf3de6, role.id=4982f0e43bc8430d81d3906431eff62e, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:20.721870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0f2d2-6428-4fd0-a37e-faa3b1811343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:20.724206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ff111-7ada-447e-ae3d-7936790a1bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:20.725105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ff111-7ada-447e-ae3d-7936790a1bfc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:20.725919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0f2d2-6428-4fd0-a37e-faa3b1811343 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:20.726739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ff111-7ada-447e-ae3d-7936790a1bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:20.727345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ff111-7ada-447e-ae3d-7936790a1bfc None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:20.729363 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ff111-7ada-447e-ae3d-7936790a1bfc None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:20.731784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ff111-7ada-447e-ae3d-7936790a1bfc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:20.734615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 184/370] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 12 20:17:20 2022] GET /identity/v3/role_assignments?group.id=da86f25140dd4e8490302ac941bf3de6&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=4982f0e43bc8430d81d3906431eff62e => generated 260 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:20.735654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0f2d2-6428-4fd0-a37e-faa3b1811343 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:20.743865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 187/371] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:20 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:20.745428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ff111-7ada-447e-ae3d-7936790a1bfc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:20.870988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0f2d2-6428-4fd0-a37e-faa3b1811343 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:20.912785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495cd7d-f6ef-4355-b9a5-f27050b9ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:20.913945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495cd7d-f6ef-4355-b9a5-f27050b9ed55 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:20.914232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495cd7d-f6ef-4355-b9a5-f27050b9ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:20.914673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495cd7d-f6ef-4355-b9a5-f27050b9ed55 None admin] PATH_INFO: `/v3/users/4246b99f33614dc28772038f56467e55` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:20.916880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495cd7d-f6ef-4355-b9a5-f27050b9ed55 None admin] RBAC: Authorizing `identity:get_user(user_id=4246b99f33614dc28772038f56467e55)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:20.919925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495cd7d-f6ef-4355-b9a5-f27050b9ed55 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:20.923827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 185/372] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:17:20 2022] GET /identity/v3/users/4246b99f33614dc28772038f56467e55 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:20.925032 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495cd7d-f6ef-4355-b9a5-f27050b9ed55 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:20.976106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ff111-7ada-447e-ae3d-7936790a1bfc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:21.034950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75181014-cc5c-4bd7-9fe9-082f19a5a8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:21.035650 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181014-cc5c-4bd7-9fe9-082f19a5a8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.035945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181014-cc5c-4bd7-9fe9-082f19a5a8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.036232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181014-cc5c-4bd7-9fe9-082f19a5a8c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.037014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75181014-cc5c-4bd7-9fe9-082f19a5a8c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:21.037379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75181014-cc5c-4bd7-9fe9-082f19a5a8c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:21.039162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75181014-cc5c-4bd7-9fe9-082f19a5a8c7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:21.052173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 188/373] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:21.053068 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75181014-cc5c-4bd7-9fe9-082f19a5a8c7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:21.063981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495cd7d-f6ef-4355-b9a5-f27050b9ed55 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:21.108613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253e33-3d38-4ed8-bec8-ef0e53433886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:21.109692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253e33-3d38-4ed8-bec8-ef0e53433886 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.109979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253e33-3d38-4ed8-bec8-ef0e53433886 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.110660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253e33-3d38-4ed8-bec8-ef0e53433886 None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.112187 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253e33-3d38-4ed8-bec8-ef0e53433886 None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:21.113897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253e33-3d38-4ed8-bec8-ef0e53433886 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:21.116397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 186/374] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:20 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:21.117192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253e33-3d38-4ed8-bec8-ef0e53433886 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:21.199705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75181014-cc5c-4bd7-9fe9-082f19a5a8c7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:21.238407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed74b3-47f6-4d97-bc72-cd3f0b8432ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:21.239085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed74b3-47f6-4d97-bc72-cd3f0b8432ca None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.239374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed74b3-47f6-4d97-bc72-cd3f0b8432ca None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.239662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed74b3-47f6-4d97-bc72-cd3f0b8432ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.240516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed74b3-47f6-4d97-bc72-cd3f0b8432ca None admin] RBAC: Adding query filter params (role.id=ef402940c145454090aa4eba58af85bf, user.id=4246b99f33614dc28772038f56467e55, scope.system=all) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:21.240834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed74b3-47f6-4d97-bc72-cd3f0b8432ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:21.242344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed74b3-47f6-4d97-bc72-cd3f0b8432ca None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:21.244001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253e33-3d38-4ed8-bec8-ef0e53433886 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:21.258636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 189/375] 10.222.0.59 () {56 vars in 1308 bytes} [Thu May 12 20:17:21 2022] GET /identity/v3/role_assignments?user.id=4246b99f33614dc28772038f56467e55&scope.system=all&role.id=ef402940c145454090aa4eba58af85bf => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:21.259607 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed74b3-47f6-4d97-bc72-cd3f0b8432ca None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:21.281053 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05096-9977-4eee-abe9-41dc92793234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:21.281770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05096-9977-4eee-abe9-41dc92793234 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.282054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05096-9977-4eee-abe9-41dc92793234 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.282333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05096-9977-4eee-abe9-41dc92793234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.364014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea05096-9977-4eee-abe9-41dc92793234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:21.365440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea05096-9977-4eee-abe9-41dc92793234 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:21.401541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed74b3-47f6-4d97-bc72-cd3f0b8432ca None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:21.441890 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5ee52-a8c1-4a38-9893-d44c07c87c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:21.442572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5ee52-a8c1-4a38-9893-d44c07c87c1b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.442861 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5ee52-a8c1-4a38-9893-d44c07c87c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.443143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5ee52-a8c1-4a38-9893-d44c07c87c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.444002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5ee52-a8c1-4a38-9893-d44c07c87c1b None admin] RBAC: Adding query filter params (group.id=da86f25140dd4e8490302ac941bf3de6, role.id=2f9013fc95d448a5b605f539fb6ae08f, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:21.444318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5ee52-a8c1-4a38-9893-d44c07c87c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:21.446864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5ee52-a8c1-4a38-9893-d44c07c87c1b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:21.453432 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 190/376] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 12 20:17:21 2022] GET /identity/v3/role_assignments?group.id=da86f25140dd4e8490302ac941bf3de6&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=2f9013fc95d448a5b605f539fb6ae08f => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:21.454798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09439d48-b0b1-446e-9aab-6c00cce920e0 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.455093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09439d48-b0b1-446e-9aab-6c00cce920e0 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.455381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09439d48-b0b1-446e-9aab-6c00cce920e0 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.456732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 191/377] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:21.463591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526ca4-fedd-45bf-a2ef-6bdf9664e7c2 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.463957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526ca4-fedd-45bf-a2ef-6bdf9664e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.464319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526ca4-fedd-45bf-a2ef-6bdf9664e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.482625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-0a526ca4-fedd-45bf-a2ef-6bdf9664e7c2 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:21.483891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0a526ca4-fedd-45bf-a2ef-6bdf9664e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:21.498217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 187/378] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:21.506001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05096-9977-4eee-abe9-41dc92793234 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:21.568724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 192/379] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:21.594015 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a526ca4-fedd-45bf-a2ef-6bdf9664e7c2 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:21.638726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05096-9977-4eee-abe9-41dc92793234 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:21.676170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd2f8b-02be-44d1-b650-489091e4b6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:21.677060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd2f8b-02be-44d1-b650-489091e4b6ce None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.677363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd2f8b-02be-44d1-b650-489091e4b6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.677640 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd2f8b-02be-44d1-b650-489091e4b6ce None admin] PATH_INFO: `/v3/projects/023813922bcf4863880d01ff0f27548c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.678970 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd2f8b-02be-44d1-b650-489091e4b6ce None admin] RBAC: Authorizing `identity:get_project(project_id=023813922bcf4863880d01ff0f27548c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:21.681787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd2f8b-02be-44d1-b650-489091e4b6ce None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:21.683935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 188/380] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:21 2022] GET /identity/v3/projects/023813922bcf4863880d01ff0f27548c => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:21.689290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd2f8b-02be-44d1-b650-489091e4b6ce None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:21.707530 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a526ca4-fedd-45bf-a2ef-6bdf9664e7c2 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:21.747285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e49b7-3dd4-4d42-9b3f-6d32fe28fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:21.748125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e49b7-3dd4-4d42-9b3f-6d32fe28fd18 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.748414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e49b7-3dd4-4d42-9b3f-6d32fe28fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.748695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e49b7-3dd4-4d42-9b3f-6d32fe28fd18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.761106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e49b7-3dd4-4d42-9b3f-6d32fe28fd18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-8a5e49b7-3dd4-4d42-9b3f-6d32fe28fd18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:21.769020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:21.771487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:21.773572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 193/381] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:21.781473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e49b7-3dd4-4d42-9b3f-6d32fe28fd18 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:21.809316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd2f8b-02be-44d1-b650-489091e4b6ce None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:21.847183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f7a36-e454-44d1-9273-b398f9f98009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:21.848062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f7a36-e454-44d1-9273-b398f9f98009 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.848345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f7a36-e454-44d1-9273-b398f9f98009 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.848627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f7a36-e454-44d1-9273-b398f9f98009 None admin] PATH_INFO: `/v3/groups/47071494484c4788a79d8652a57fa0fd` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.856331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f7a36-e454-44d1-9273-b398f9f98009 None admin] RBAC: Authorizing `identity:get_group(group_id=47071494484c4788a79d8652a57fa0fd)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:21.863627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f7a36-e454-44d1-9273-b398f9f98009 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:21.863627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 189/382] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:21 2022] GET /identity/v3/groups/47071494484c4788a79d8652a57fa0fd => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:21.871499 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f7a36-e454-44d1-9273-b398f9f98009 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:21.894846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e49b7-3dd4-4d42-9b3f-6d32fe28fd18 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:21.948043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c981-6fd8-444f-a141-1c8dd287c459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:21.948784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c981-6fd8-444f-a141-1c8dd287c459 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:21.949073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c981-6fd8-444f-a141-1c8dd287c459 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:21.949397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c981-6fd8-444f-a141-1c8dd287c459 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:21.951110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c981-6fd8-444f-a141-1c8dd287c459 None admin] RBAC: Adding query filter params (name=member) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:21.951441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c981-6fd8-444f-a141-1c8dd287c459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:21.952853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c981-6fd8-444f-a141-1c8dd287c459 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:21.965967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 194/383] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:21.971522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c981-6fd8-444f-a141-1c8dd287c459 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:22.092179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f7a36-e454-44d1-9273-b398f9f98009 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:22.138589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c981-6fd8-444f-a141-1c8dd287c459 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:22.168051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b512-f377-437c-af8b-b059b0da0d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:22.169071 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b512-f377-437c-af8b-b059b0da0d44 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:22.169589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b512-f377-437c-af8b-b059b0da0d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:22.170068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b512-f377-437c-af8b-b059b0da0d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:22.171105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b512-f377-437c-af8b-b059b0da0d44 None admin] RBAC: Adding query filter params (group.id=47071494484c4788a79d8652a57fa0fd, role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=023813922bcf4863880d01ff0f27548c) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:22.171612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b512-f377-437c-af8b-b059b0da0d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:22.173292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b512-f377-437c-af8b-b059b0da0d44 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:22.192476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 190/384] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 12 20:17:21 2022] GET /identity/v3/role_assignments?group.id=47071494484c4788a79d8652a57fa0fd&scope.project.id=023813922bcf4863880d01ff0f27548c&role.id=4ae0665802b946be870ab06274297a1d => generated 260 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:22.201100 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87bcf9-6778-43fa-b75a-12facacc5831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:22.202021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87bcf9-6778-43fa-b75a-12facacc5831 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:22.202306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87bcf9-6778-43fa-b75a-12facacc5831 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:22.202585 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87bcf9-6778-43fa-b75a-12facacc5831 None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:22.206175 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87bcf9-6778-43fa-b75a-12facacc5831 None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:22.207753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87bcf9-6778-43fa-b75a-12facacc5831 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:22.209680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 195/385] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:21 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:22.216941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b512-f377-437c-af8b-b059b0da0d44 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:22.377801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b512-f377-437c-af8b-b059b0da0d44 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:22.421227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee1d77-8e31-41dc-bf96-a45dd65de569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:22.422065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee1d77-8e31-41dc-bf96-a45dd65de569 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:22.422351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee1d77-8e31-41dc-bf96-a45dd65de569 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:22.422633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee1d77-8e31-41dc-bf96-a45dd65de569 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:22.431398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee1d77-8e31-41dc-bf96-a45dd65de569 None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:22.432754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee1d77-8e31-41dc-bf96-a45dd65de569 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:22.435142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 191/386] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:22 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:22.440912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87bcf9-6778-43fa-b75a-12facacc5831 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:22.553763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87bcf9-6778-43fa-b75a-12facacc5831 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:22.606441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491faa3-0c3f-4a78-a09e-48b2a47c357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:22.607352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491faa3-0c3f-4a78-a09e-48b2a47c357c None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:22.607640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491faa3-0c3f-4a78-a09e-48b2a47c357c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:22.607917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491faa3-0c3f-4a78-a09e-48b2a47c357c None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34/groups/da86f25140dd4e8490302ac941bf3de6/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:22.609986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491faa3-0c3f-4a78-a09e-48b2a47c357c None admin] RBAC: Authorizing `identity:create_grant(project_id=1a986d55348f4996bbf49674a39f2e34, group_id=da86f25140dd4e8490302ac941bf3de6, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:22.611578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491faa3-0c3f-4a78-a09e-48b2a47c357c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:22.733499 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 196/387] 10.222.0.59 () {58 vars in 1442 bytes} [Thu May 12 20:17:22 2022] PUT /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34/groups/da86f25140dd4e8490302ac941bf3de6/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:23.411471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabbad7-6fdc-4311-80c3-f75bd34a5bb1 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:23.412465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabbad7-6fdc-4311-80c3-f75bd34a5bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:23.412979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabbad7-6fdc-4311-80c3-f75bd34a5bb1 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:23.415354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 192/388] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:23.420967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9c74b-75e7-4d5f-979f-8387b6cfcf69 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:23.421572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9c74b-75e7-4d5f-979f-8387b6cfcf69 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:23.422055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9c74b-75e7-4d5f-979f-8387b6cfcf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:23.442653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-16e9c74b-75e7-4d5f-979f-8387b6cfcf69 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:23.444193 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-16e9c74b-75e7-4d5f-979f-8387b6cfcf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:23.531635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 197/389] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:23.562932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabbad7-6fdc-4311-80c3-f75bd34a5bb1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:23.722069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabbad7-6fdc-4311-80c3-f75bd34a5bb1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:23.771377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80f010-825c-44be-a12e-2c7ea244d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:23.772207 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80f010-825c-44be-a12e-2c7ea244d52a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:23.772488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80f010-825c-44be-a12e-2c7ea244d52a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:23.772759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80f010-825c-44be-a12e-2c7ea244d52a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:23.787791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80f010-825c-44be-a12e-2c7ea244d52a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-6b80f010-825c-44be-a12e-2c7ea244d52a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:23.800783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:23.801759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:23.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 193/390] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:17:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:23.808231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9c74b-75e7-4d5f-979f-8387b6cfcf69 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:24.019662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9c74b-75e7-4d5f-979f-8387b6cfcf69 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:24.066990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba24b1-43e3-4e93-8805-a93ed55897ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:24.067686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba24b1-43e3-4e93-8805-a93ed55897ea None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:24.067970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba24b1-43e3-4e93-8805-a93ed55897ea None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:24.068248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba24b1-43e3-4e93-8805-a93ed55897ea None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:24.069019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba24b1-43e3-4e93-8805-a93ed55897ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:24.069352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba24b1-43e3-4e93-8805-a93ed55897ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:24.070796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba24b1-43e3-4e93-8805-a93ed55897ea None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:24.085078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 198/391] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:24.091204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80f010-825c-44be-a12e-2c7ea244d52a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:24.241154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80f010-825c-44be-a12e-2c7ea244d52a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:24.294164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6da19c-76d8-4f0d-8132-085c87a18967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:24.295295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6da19c-76d8-4f0d-8132-085c87a18967 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:24.295726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6da19c-76d8-4f0d-8132-085c87a18967 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:24.296158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6da19c-76d8-4f0d-8132-085c87a18967 None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:24.297657 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6da19c-76d8-4f0d-8132-085c87a18967 None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:24.299263 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6da19c-76d8-4f0d-8132-085c87a18967 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:24.301054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 194/392] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:24 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:24.307080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba24b1-43e3-4e93-8805-a93ed55897ea None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:24.479530 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba24b1-43e3-4e93-8805-a93ed55897ea None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:24.534894 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a37d80-fb8f-4042-a6e4-f0ca43a0266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:24.536011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a37d80-fb8f-4042-a6e4-f0ca43a0266a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:24.536438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a37d80-fb8f-4042-a6e4-f0ca43a0266a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:24.536853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a37d80-fb8f-4042-a6e4-f0ca43a0266a None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:24.538235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a37d80-fb8f-4042-a6e4-f0ca43a0266a None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:24.540416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a37d80-fb8f-4042-a6e4-f0ca43a0266a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:24.542653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 199/393] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:24 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:24.548043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6da19c-76d8-4f0d-8132-085c87a18967 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:24.560683 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1697b-ba6a-4cc8-80b4-c1161011e9e3 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:24.563310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1697b-ba6a-4cc8-80b4-c1161011e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:24.563770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1697b-ba6a-4cc8-80b4-c1161011e9e3 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:24.565343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 200/394] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:24.572194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecae3e3-816f-4a93-b0de-611f859794ba None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:24.574102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecae3e3-816f-4a93-b0de-611f859794ba None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:24.574537 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecae3e3-816f-4a93-b0de-611f859794ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:24.611204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-2ecae3e3-816f-4a93-b0de-611f859794ba None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:24.612652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2ecae3e3-816f-4a93-b0de-611f859794ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:24.685427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6da19c-76d8-4f0d-8132-085c87a18967 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:24.724241 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac31a9-604d-422b-ad09-e0616b735ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:24.725136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac31a9-604d-422b-ad09-e0616b735ad7 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:24.725464 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac31a9-604d-422b-ad09-e0616b735ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:24.725740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac31a9-604d-422b-ad09-e0616b735ad7 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34/groups/da86f25140dd4e8490302ac941bf3de6/roles/2f9013fc95d448a5b605f539fb6ae08f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:24.737514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac31a9-604d-422b-ad09-e0616b735ad7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a986d55348f4996bbf49674a39f2e34, group_id=da86f25140dd4e8490302ac941bf3de6, role_id=2f9013fc95d448a5b605f539fb6ae08f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:24.737514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac31a9-604d-422b-ad09-e0616b735ad7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:24.737794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 201/395] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:24.737794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058215c-b98e-4932-a5f5-f4ed7903fa11 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:24.737794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058215c-b98e-4932-a5f5-f4ed7903fa11 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:24.737794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058215c-b98e-4932-a5f5-f4ed7903fa11 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:24.737794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 202/396] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:24.746028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760113-4e8e-492a-ba67-0c3acd928d70 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:24.746647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760113-4e8e-492a-ba67-0c3acd928d70 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:24.747071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760113-4e8e-492a-ba67-0c3acd928d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:24.766755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d2760113-4e8e-492a-ba67-0c3acd928d70 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:24.768181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d2760113-4e8e-492a-ba67-0c3acd928d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:24.825222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 195/397] 10.222.0.59 () {58 vars in 1442 bytes} [Thu May 12 20:17:24 2022] PUT /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34/groups/da86f25140dd4e8490302ac941bf3de6/roles/2f9013fc95d448a5b605f539fb6ae08f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:24.830566 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac31a9-604d-422b-ad09-e0616b735ad7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:24.849700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 203/398] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:24.873979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2760113-4e8e-492a-ba67-0c3acd928d70 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:24.993795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2760113-4e8e-492a-ba67-0c3acd928d70 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.002628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac31a9-604d-422b-ad09-e0616b735ad7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.032416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52a677-2a2c-4969-99f7-b7b7a02c783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.033268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52a677-2a2c-4969-99f7-b7b7a02c783e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.033935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52a677-2a2c-4969-99f7-b7b7a02c783e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.033935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52a677-2a2c-4969-99f7-b7b7a02c783e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.044012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053b645-174b-4fec-a07c-1ca421e08845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.045211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053b645-174b-4fec-a07c-1ca421e08845 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.045764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053b645-174b-4fec-a07c-1ca421e08845 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.046247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053b645-174b-4fec-a07c-1ca421e08845 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.048109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52a677-2a2c-4969-99f7-b7b7a02c783e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-1e52a677-2a2c-4969-99f7-b7b7a02c783e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:25.058046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:25.059029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:25.060301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:25.063386 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053b645-174b-4fec-a07c-1ca421e08845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:25.066904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 204/399] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:25.068518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f56c1e-92e0-4bee-aca9-df95463f8d34 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.068814 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f56c1e-92e0-4bee-aca9-df95463f8d34 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.069100 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f56c1e-92e0-4bee-aca9-df95463f8d34 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.071244 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 205/400] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:25.075966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f56c1e-92e0-4bee-aca9-df95463f8d34 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5053b645-174b-4fec-a07c-1ca421e08845 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:25.081444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:25.084084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:25.084891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 196/401] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:17:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:25.086872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df2f39-bccb-4a01-b1db-359bd331e52d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.086872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df2f39-bccb-4a01-b1db-359bd331e52d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.086872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df2f39-bccb-4a01-b1db-359bd331e52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.112032 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b2df2f39-bccb-4a01-b1db-359bd331e52d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:25.113791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b2df2f39-bccb-4a01-b1db-359bd331e52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:25.208844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 197/402] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:25.210185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df2f39-bccb-4a01-b1db-359bd331e52d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:25.215051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f56c1e-92e0-4bee-aca9-df95463f8d34 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.257686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cffaa1-a088-4956-abc3-994bae0646e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.259137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cffaa1-a088-4956-abc3-994bae0646e5 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.259424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cffaa1-a088-4956-abc3-994bae0646e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.259704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cffaa1-a088-4956-abc3-994bae0646e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.260868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cffaa1-a088-4956-abc3-994bae0646e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:25.261187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cffaa1-a088-4956-abc3-994bae0646e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:25.262973 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cffaa1-a088-4956-abc3-994bae0646e5 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:25.276986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 206/403] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:25.278233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cffaa1-a088-4956-abc3-994bae0646e5 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:25.324523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df2f39-bccb-4a01-b1db-359bd331e52d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.362305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d10ab-8a40-49a0-bf69-3674fdf3c687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.363356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d10ab-8a40-49a0-bf69-3674fdf3c687 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.363863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d10ab-8a40-49a0-bf69-3674fdf3c687 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.364355 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d10ab-8a40-49a0-bf69-3674fdf3c687 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.365389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d10ab-8a40-49a0-bf69-3674fdf3c687 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:25.365923 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d10ab-8a40-49a0-bf69-3674fdf3c687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:25.367570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d10ab-8a40-49a0-bf69-3674fdf3c687 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:25.376996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 198/404] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:25.378305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d10ab-8a40-49a0-bf69-3674fdf3c687 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:25.409707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cffaa1-a088-4956-abc3-994bae0646e5 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.464026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9a866-6b8f-4c5a-9b56-12e55e780430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.465202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9a866-6b8f-4c5a-9b56-12e55e780430 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.465731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9a866-6b8f-4c5a-9b56-12e55e780430 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.466212 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9a866-6b8f-4c5a-9b56-12e55e780430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.477784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9a866-6b8f-4c5a-9b56-12e55e780430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-c9c9a866-6b8f-4c5a-9b56-12e55e780430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:25.485898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:25.486835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:17:25.487641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:25.490095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 207/405] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:25.491318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9a866-6b8f-4c5a-9b56-12e55e780430 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:25.519263 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d10ab-8a40-49a0-bf69-3674fdf3c687 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.561882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5b7f9-27af-449e-a874-1e37d97e8695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.563562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b7f9-27af-449e-a874-1e37d97e8695 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.564052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b7f9-27af-449e-a874-1e37d97e8695 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.564533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b7f9-27af-449e-a874-1e37d97e8695 None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.566066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5b7f9-27af-449e-a874-1e37d97e8695 None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:25.567765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5b7f9-27af-449e-a874-1e37d97e8695 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:25.569764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 199/406] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:25 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:25.571859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5b7f9-27af-449e-a874-1e37d97e8695 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:25.610958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9a866-6b8f-4c5a-9b56-12e55e780430 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.646621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486e16-b370-43dd-a925-6ba97b66c008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.647417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486e16-b370-43dd-a925-6ba97b66c008 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.647707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486e16-b370-43dd-a925-6ba97b66c008 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.647987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c486e16-b370-43dd-a925-6ba97b66c008 None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.649679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c486e16-b370-43dd-a925-6ba97b66c008 None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:25.651649 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c486e16-b370-43dd-a925-6ba97b66c008 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:25.657628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 208/407] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:25 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:25.658441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486e16-b370-43dd-a925-6ba97b66c008 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:25.682212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5b7f9-27af-449e-a874-1e37d97e8695 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.718581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f7a8-a6eb-4c91-ad8d-d00adcbea68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.719276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f7a8-a6eb-4c91-ad8d-d00adcbea68a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.719566 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f7a8-a6eb-4c91-ad8d-d00adcbea68a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.719851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f7a8-a6eb-4c91-ad8d-d00adcbea68a None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.720651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4f7a8-a6eb-4c91-ad8d-d00adcbea68a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:25.720966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4f7a8-a6eb-4c91-ad8d-d00adcbea68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:25.722399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4f7a8-a6eb-4c91-ad8d-d00adcbea68a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:25.731567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 200/408] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:25.732504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f7a8-a6eb-4c91-ad8d-d00adcbea68a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:25.775101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c486e16-b370-43dd-a925-6ba97b66c008 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.814118 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bce001-c8e4-48d1-8fe8-aaa6c41e7180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.815009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bce001-c8e4-48d1-8fe8-aaa6c41e7180 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.815300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bce001-c8e4-48d1-8fe8-aaa6c41e7180 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.815583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bce001-c8e4-48d1-8fe8-aaa6c41e7180 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.816808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bce001-c8e4-48d1-8fe8-aaa6c41e7180 None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:25.818307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bce001-c8e4-48d1-8fe8-aaa6c41e7180 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:25.820971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 209/409] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:25 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:25.822358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690be5e-9433-4e4c-8333-bf3a235c7193 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.822660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690be5e-9433-4e4c-8333-bf3a235c7193 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.822938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690be5e-9433-4e4c-8333-bf3a235c7193 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.824195 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 210/410] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:25.824896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690be5e-9433-4e4c-8333-bf3a235c7193 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:25.852854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f7a8-a6eb-4c91-ad8d-d00adcbea68a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.896924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a51fac-96d2-4a0e-af34-4b6c475c5af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.898144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a51fac-96d2-4a0e-af34-4b6c475c5af7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.898435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a51fac-96d2-4a0e-af34-4b6c475c5af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:25.898921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a51fac-96d2-4a0e-af34-4b6c475c5af7 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:25.900391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a51fac-96d2-4a0e-af34-4b6c475c5af7 None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:25.901899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a51fac-96d2-4a0e-af34-4b6c475c5af7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:25.903644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 201/411] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:25 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:25.908323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a51fac-96d2-4a0e-af34-4b6c475c5af7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:25.951929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690be5e-9433-4e4c-8333-bf3a235c7193 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:25.997352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cffb29-5b89-4c98-8175-bfa7af92afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:25.998171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cffb29-5b89-4c98-8175-bfa7af92afe0 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:25.998455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cffb29-5b89-4c98-8175-bfa7af92afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:26.001297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cffb29-5b89-4c98-8175-bfa7af92afe0 None admin] PATH_INFO: `/v3/groups/47071494484c4788a79d8652a57fa0fd` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:26.001297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cffb29-5b89-4c98-8175-bfa7af92afe0 None admin] RBAC: Authorizing `identity:get_group(group_id=47071494484c4788a79d8652a57fa0fd)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:26.001454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cffb29-5b89-4c98-8175-bfa7af92afe0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:26.003201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 211/412] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:25 2022] GET /identity/v3/groups/47071494484c4788a79d8652a57fa0fd => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:26.008154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2992226-6e5f-490c-8432-2594c7062490 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:26.008715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2992226-6e5f-490c-8432-2594c7062490 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:26.009111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2992226-6e5f-490c-8432-2594c7062490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:26.017825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a51fac-96d2-4a0e-af34-4b6c475c5af7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:26.027281 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a2992226-6e5f-490c-8432-2594c7062490 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:26.028491 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a2992226-6e5f-490c-8432-2594c7062490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:26.057953 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bedda-4525-4d53-9c67-0e64b05ae5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:26.058848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bedda-4525-4d53-9c67-0e64b05ae5d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:26.059144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bedda-4525-4d53-9c67-0e64b05ae5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:26.059510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bedda-4525-4d53-9c67-0e64b05ae5d7 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/groups/da86f25140dd4e8490302ac941bf3de6/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:26.061556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bedda-4525-4d53-9c67-0e64b05ae5d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598, group_id=da86f25140dd4e8490302ac941bf3de6, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:26.063078 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bedda-4525-4d53-9c67-0e64b05ae5d7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:26.094691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 212/413] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:26.095529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2992226-6e5f-490c-8432-2594c7062490 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:26.178162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 202/414] 10.222.0.59 () {58 vars in 1442 bytes} [Thu May 12 20:17:25 2022] PUT /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/groups/da86f25140dd4e8490302ac941bf3de6/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:26.179266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bedda-4525-4d53-9c67-0e64b05ae5d7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:26.206667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2992226-6e5f-490c-8432-2594c7062490 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:26.256381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315913c-8763-4618-af22-0a350518c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:26.258308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315913c-8763-4618-af22-0a350518c485 None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:26.258798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315913c-8763-4618-af22-0a350518c485 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:26.259510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315913c-8763-4618-af22-0a350518c485 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/groups/da86f25140dd4e8490302ac941bf3de6/roles/2f9013fc95d448a5b605f539fb6ae08f` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:26.263608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315913c-8763-4618-af22-0a350518c485 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598, group_id=da86f25140dd4e8490302ac941bf3de6, role_id=2f9013fc95d448a5b605f539fb6ae08f)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:26.265628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315913c-8763-4618-af22-0a350518c485 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:26.311044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bedda-4525-4d53-9c67-0e64b05ae5d7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:26.339746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 213/415] 10.222.0.59 () {58 vars in 1442 bytes} [Thu May 12 20:17:26 2022] PUT /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598/groups/da86f25140dd4e8490302ac941bf3de6/roles/2f9013fc95d448a5b605f539fb6ae08f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:26.341237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315913c-8763-4618-af22-0a350518c485 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:26.384014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23960d65-06f2-4866-a2e9-5de56d3ad0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:26.385047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23960d65-06f2-4866-a2e9-5de56d3ad0ed None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:26.385158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23960d65-06f2-4866-a2e9-5de56d3ad0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:26.385516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23960d65-06f2-4866-a2e9-5de56d3ad0ed None admin] PATH_INFO: `/v3/projects/023813922bcf4863880d01ff0f27548c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:26.386843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23960d65-06f2-4866-a2e9-5de56d3ad0ed None admin] RBAC: Authorizing `identity:get_project(project_id=023813922bcf4863880d01ff0f27548c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:26.388446 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23960d65-06f2-4866-a2e9-5de56d3ad0ed None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:26.390342 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 203/416] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:26 2022] GET /identity/v3/projects/023813922bcf4863880d01ff0f27548c => generated 344 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:26.396262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23960d65-06f2-4866-a2e9-5de56d3ad0ed None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:26.513395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315913c-8763-4618-af22-0a350518c485 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:26.563471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23960d65-06f2-4866-a2e9-5de56d3ad0ed None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:26.571999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edb5e6-5bdb-48cd-a06b-22f0fafd2f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:26.572956 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edb5e6-5bdb-48cd-a06b-22f0fafd2f73 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:26.573142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edb5e6-5bdb-48cd-a06b-22f0fafd2f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:26.573408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edb5e6-5bdb-48cd-a06b-22f0fafd2f73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:26.597456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edb5e6-5bdb-48cd-a06b-22f0fafd2f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:26.605614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a603f19-f9c5-40b6-ba8d-06258399c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-04edb5e6-5bdb-48cd-a06b-22f0fafd2f73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:26.606740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:26.607606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:26.608402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:26.610681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a603f19-f9c5-40b6-ba8d-06258399c505 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:26.611222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a603f19-f9c5-40b6-ba8d-06258399c505 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:26.611708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a603f19-f9c5-40b6-ba8d-06258399c505 None admin] PATH_INFO: `/v3/projects/023813922bcf4863880d01ff0f27548c/groups/47071494484c4788a79d8652a57fa0fd/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:26.612793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 214/417] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:26.614126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edb5e6-5bdb-48cd-a06b-22f0fafd2f73 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:26.614567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a603f19-f9c5-40b6-ba8d-06258399c505 None admin] RBAC: Authorizing `identity:create_grant(project_id=023813922bcf4863880d01ff0f27548c, group_id=47071494484c4788a79d8652a57fa0fd, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:26.616252 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a603f19-f9c5-40b6-ba8d-06258399c505 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:26.700575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 204/418] 10.222.0.59 () {58 vars in 1442 bytes} [Thu May 12 20:17:26 2022] PUT /identity/v3/projects/023813922bcf4863880d01ff0f27548c/groups/47071494484c4788a79d8652a57fa0fd/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:17:26.747278 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edb5e6-5bdb-48cd-a06b-22f0fafd2f73 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:26.795206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c96d-71a6-4238-8516-ba981d74132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:26.795829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c96d-71a6-4238-8516-ba981d74132f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:26.796174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c96d-71a6-4238-8516-ba981d74132f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:26.796457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c96d-71a6-4238-8516-ba981d74132f None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:26.797232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c96d-71a6-4238-8516-ba981d74132f None admin] RBAC: Adding query filter params (name=member) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:26.797563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c96d-71a6-4238-8516-ba981d74132f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:26.799009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c96d-71a6-4238-8516-ba981d74132f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:26.809204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 215/419] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:26.814920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a603f19-f9c5-40b6-ba8d-06258399c505 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:27.020696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a603f19-f9c5-40b6-ba8d-06258399c505 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:27.069663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7f973-6274-4c09-9023-7ea7f9737493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:27.070320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f973-6274-4c09-9023-7ea7f9737493 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:27.071276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f973-6274-4c09-9023-7ea7f9737493 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:27.071565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7f973-6274-4c09-9023-7ea7f9737493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:27.156571 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7f973-6274-4c09-9023-7ea7f9737493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:27.158069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7f973-6274-4c09-9023-7ea7f9737493 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:27.303603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 205/420] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:27.310485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c96d-71a6-4238-8516-ba981d74132f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:27.501128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25f6b-d2f2-49d0-aab5-9ecad53af31e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:27.501553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25f6b-d2f2-49d0-aab5-9ecad53af31e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:27.501741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25f6b-d2f2-49d0-aab5-9ecad53af31e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:27.503367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 206/421] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:27.518840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c96d-71a6-4238-8516-ba981d74132f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:27.519192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0979b-3dde-4df5-b40b-0766a9b2bc0b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:27.519490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0979b-3dde-4df5-b40b-0766a9b2bc0b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:27.519783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0979b-3dde-4df5-b40b-0766a9b2bc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:27.546601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-bdc0979b-3dde-4df5-b40b-0766a9b2bc0b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:27.548188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bdc0979b-3dde-4df5-b40b-0766a9b2bc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:27.555431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8488495-9b3d-4ae2-b5d0-2cd0d6c0576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:27.556464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8488495-9b3d-4ae2-b5d0-2cd0d6c0576e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:27.556755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8488495-9b3d-4ae2-b5d0-2cd0d6c0576e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:27.557033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8488495-9b3d-4ae2-b5d0-2cd0d6c0576e None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:27.562811 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8488495-9b3d-4ae2-b5d0-2cd0d6c0576e None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:27.564286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8488495-9b3d-4ae2-b5d0-2cd0d6c0576e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:27.568407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 216/422] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:27 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:27.574635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8488495-9b3d-4ae2-b5d0-2cd0d6c0576e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:27.660026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 207/423] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:27.685858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8488495-9b3d-4ae2-b5d0-2cd0d6c0576e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:27.701300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0979b-3dde-4df5-b40b-0766a9b2bc0b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:27.721931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d344b1-fda4-4e08-a796-c26785a88c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:27.722805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d344b1-fda4-4e08-a796-c26785a88c0d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:27.723091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d344b1-fda4-4e08-a796-c26785a88c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:27.723627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d344b1-fda4-4e08-a796-c26785a88c0d None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:27.724622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d344b1-fda4-4e08-a796-c26785a88c0d None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:27.726127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d344b1-fda4-4e08-a796-c26785a88c0d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:27.728154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 217/424] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:27 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:27.736200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d344b1-fda4-4e08-a796-c26785a88c0d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:27.860484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d344b1-fda4-4e08-a796-c26785a88c0d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:27.905970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faf879-f7ea-4e7f-817e-f8ae0345d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:27.906655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faf879-f7ea-4e7f-817e-f8ae0345d1cb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:27.906944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faf879-f7ea-4e7f-817e-f8ae0345d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:27.907227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faf879-f7ea-4e7f-817e-f8ae0345d1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:27.908088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faf879-f7ea-4e7f-817e-f8ae0345d1cb None admin] RBAC: Adding query filter params (group.id=da86f25140dd4e8490302ac941bf3de6, role.id=4982f0e43bc8430d81d3906431eff62e, scope.project.id=1a986d55348f4996bbf49674a39f2e34) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:27.908406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faf879-f7ea-4e7f-817e-f8ae0345d1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:27.909891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faf879-f7ea-4e7f-817e-f8ae0345d1cb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:27.920588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 218/425] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 12 20:17:27 2022] GET /identity/v3/role_assignments?group.id=da86f25140dd4e8490302ac941bf3de6&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=4982f0e43bc8430d81d3906431eff62e => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:27.946833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0979b-3dde-4df5-b40b-0766a9b2bc0b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:27.988645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322e648-e5e5-4b72-9cd9-e2fe2d49cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:27.989522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322e648-e5e5-4b72-9cd9-e2fe2d49cc90 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:27.989814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322e648-e5e5-4b72-9cd9-e2fe2d49cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:27.990101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322e648-e5e5-4b72-9cd9-e2fe2d49cc90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:28.009442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322e648-e5e5-4b72-9cd9-e2fe2d49cc90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f322e648-e5e5-4b72-9cd9-e2fe2d49cc90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:28.020129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:28.021105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:28.023360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 208/426] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:17:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:28.028335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faf879-f7ea-4e7f-817e-f8ae0345d1cb None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:28.199408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faf879-f7ea-4e7f-817e-f8ae0345d1cb None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:28.244644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a23c73-29f4-4f3f-bf7c-a29a8f4a4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:28.245743 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a23c73-29f4-4f3f-bf7c-a29a8f4a4b85 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:28.246426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a23c73-29f4-4f3f-bf7c-a29a8f4a4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:28.246918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a23c73-29f4-4f3f-bf7c-a29a8f4a4b85 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:28.247959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a23c73-29f4-4f3f-bf7c-a29a8f4a4b85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:28.248556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a23c73-29f4-4f3f-bf7c-a29a8f4a4b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:28.250242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a23c73-29f4-4f3f-bf7c-a29a8f4a4b85 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:28.265437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 219/427] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:28.270835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322e648-e5e5-4b72-9cd9-e2fe2d49cc90 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:28.380982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322e648-e5e5-4b72-9cd9-e2fe2d49cc90 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:28.421700 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d96654-5815-4d3c-ab27-af8c7bc8b149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:28.422746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d96654-5815-4d3c-ab27-af8c7bc8b149 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:28.423273 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d96654-5815-4d3c-ab27-af8c7bc8b149 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:28.423822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d96654-5815-4d3c-ab27-af8c7bc8b149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:28.499840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d96654-5815-4d3c-ab27-af8c7bc8b149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:28.501674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d96654-5815-4d3c-ab27-af8c7bc8b149 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:28.611045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 209/428] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:28.616262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a23c73-29f4-4f3f-bf7c-a29a8f4a4b85 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:28.747246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a23c73-29f4-4f3f-bf7c-a29a8f4a4b85 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:28.792215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a87be2-535c-4203-bcbf-11755db05428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:28.793015 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a87be2-535c-4203-bcbf-11755db05428 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:28.793321 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a87be2-535c-4203-bcbf-11755db05428 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:28.793608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a87be2-535c-4203-bcbf-11755db05428 None admin] PATH_INFO: `/v3/projects/1a986d55348f4996bbf49674a39f2e34` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:28.795389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a87be2-535c-4203-bcbf-11755db05428 None admin] RBAC: Authorizing `identity:get_project(project_id=1a986d55348f4996bbf49674a39f2e34)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:28.796840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a87be2-535c-4203-bcbf-11755db05428 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:28.798905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 220/429] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:28 2022] GET /identity/v3/projects/1a986d55348f4996bbf49674a39f2e34 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:28.804080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d96654-5815-4d3c-ab27-af8c7bc8b149 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:28.932490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d96654-5815-4d3c-ab27-af8c7bc8b149 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:28.985111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d862e-15ff-4227-be88-ab0f1b5d0501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:28.986048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d862e-15ff-4227-be88-ab0f1b5d0501 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:28.986338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d862e-15ff-4227-be88-ab0f1b5d0501 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:28.986620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d862e-15ff-4227-be88-ab0f1b5d0501 None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:28.987913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d862e-15ff-4227-be88-ab0f1b5d0501 None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:28.989436 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d862e-15ff-4227-be88-ab0f1b5d0501 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:28.991486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 210/430] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:28 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:28.998282 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a87be2-535c-4203-bcbf-11755db05428 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:29.145260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a87be2-535c-4203-bcbf-11755db05428 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:29.154767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685eb01-ced6-42c0-b515-0fe50850925f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.155118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685eb01-ced6-42c0-b515-0fe50850925f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.155340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685eb01-ced6-42c0-b515-0fe50850925f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.157037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 211/431] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:29.163691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c719985-75a8-43ad-8b14-f5893cbb4312 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.164507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c719985-75a8-43ad-8b14-f5893cbb4312 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.164937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c719985-75a8-43ad-8b14-f5893cbb4312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.182681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0c719985-75a8-43ad-8b14-f5893cbb4312 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:29.184261 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0c719985-75a8-43ad-8b14-f5893cbb4312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:29.193080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde45b0-1e55-4237-b0b8-e468626b0a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:29.194433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde45b0-1e55-4237-b0b8-e468626b0a6d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.194919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde45b0-1e55-4237-b0b8-e468626b0a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.195439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde45b0-1e55-4237-b0b8-e468626b0a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.196936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde45b0-1e55-4237-b0b8-e468626b0a6d None admin] RBAC: Adding query filter params (group.id=da86f25140dd4e8490302ac941bf3de6, role.id=2f9013fc95d448a5b605f539fb6ae08f, scope.project.id=1a986d55348f4996bbf49674a39f2e34) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:29.197515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde45b0-1e55-4237-b0b8-e468626b0a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:29.199470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde45b0-1e55-4237-b0b8-e468626b0a6d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:29.206115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 221/432] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 12 20:17:28 2022] GET /identity/v3/role_assignments?group.id=da86f25140dd4e8490302ac941bf3de6&scope.project.id=1a986d55348f4996bbf49674a39f2e34&role.id=2f9013fc95d448a5b605f539fb6ae08f => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:29.207663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec8f64-5e86-4f5d-a7b7-9eb53caa4e74 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.207663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec8f64-5e86-4f5d-a7b7-9eb53caa4e74 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.207989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec8f64-5e86-4f5d-a7b7-9eb53caa4e74 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.209310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 222/433] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:29.215760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11f36-0a49-4272-848a-8cc85cdf209d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.216270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11f36-0a49-4272-848a-8cc85cdf209d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.216703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11f36-0a49-4272-848a-8cc85cdf209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.236165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-02e11f36-0a49-4272-848a-8cc85cdf209d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:29.238392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-02e11f36-0a49-4272-848a-8cc85cdf209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:29.281463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 212/434] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:29.299662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c719985-75a8-43ad-8b14-f5893cbb4312 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:29.333381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 223/435] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:29.356860 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e11f36-0a49-4272-848a-8cc85cdf209d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:29.434299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c719985-75a8-43ad-8b14-f5893cbb4312 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:29.480757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf33d41-2912-4c11-a800-e67adc5a4f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:29.481618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf33d41-2912-4c11-a800-e67adc5a4f86 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.481910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf33d41-2912-4c11-a800-e67adc5a4f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.482190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf33d41-2912-4c11-a800-e67adc5a4f86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.497161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf33d41-2912-4c11-a800-e67adc5a4f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ccf33d41-2912-4c11-a800-e67adc5a4f86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:29.505682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:29.506799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:29.507708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:29.512685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e11f36-0a49-4272-848a-8cc85cdf209d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:29.512947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 213/436] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:17:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:29.513100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb5b42-60c2-4dc4-af75-c8e8644d3d84 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.513735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb5b42-60c2-4dc4-af75-c8e8644d3d84 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.513735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb5b42-60c2-4dc4-af75-c8e8644d3d84 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.515460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 214/437] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:29.516626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb5b42-60c2-4dc4-af75-c8e8644d3d84 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:29.551889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bc469-eb72-4ecd-99f3-6b893276770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:29.552800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc469-eb72-4ecd-99f3-6b893276770a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.553449 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc469-eb72-4ecd-99f3-6b893276770a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.553555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc469-eb72-4ecd-99f3-6b893276770a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.569885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bc469-eb72-4ecd-99f3-6b893276770a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-ac2bc469-eb72-4ecd-99f3-6b893276770a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:29.578522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:29.579859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:29.580646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 224/438] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:29.581864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d2ebf-7adc-43a3-b2ea-543cdb0ed3ee None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.581864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d2ebf-7adc-43a3-b2ea-543cdb0ed3ee None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.582105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d2ebf-7adc-43a3-b2ea-543cdb0ed3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.602048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-df2d2ebf-7adc-43a3-b2ea-543cdb0ed3ee None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:29.603284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-df2d2ebf-7adc-43a3-b2ea-543cdb0ed3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:29.646357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb5b42-60c2-4dc4-af75-c8e8644d3d84 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:29.688311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 225/439] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:29.688311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d2ebf-7adc-43a3-b2ea-543cdb0ed3ee None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:29.692025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120527b1-572c-4206-9477-622450695feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:29.692793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120527b1-572c-4206-9477-622450695feb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.693144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120527b1-572c-4206-9477-622450695feb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.693514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120527b1-572c-4206-9477-622450695feb None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.694341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120527b1-572c-4206-9477-622450695feb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:29.694712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120527b1-572c-4206-9477-622450695feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:29.696565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120527b1-572c-4206-9477-622450695feb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:29.706535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 215/440] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:29.708402 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120527b1-572c-4206-9477-622450695feb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:29.799526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d2ebf-7adc-43a3-b2ea-543cdb0ed3ee None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:29.825066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120527b1-572c-4206-9477-622450695feb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:29.833366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82d379-61c8-4690-8d9c-b19191dc25bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:29.834050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82d379-61c8-4690-8d9c-b19191dc25bb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.834341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82d379-61c8-4690-8d9c-b19191dc25bb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.834622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82d379-61c8-4690-8d9c-b19191dc25bb None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.835388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82d379-61c8-4690-8d9c-b19191dc25bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:29.835700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82d379-61c8-4690-8d9c-b19191dc25bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:29.837380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82d379-61c8-4690-8d9c-b19191dc25bb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:29.845914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 226/441] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:17:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:29.846737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82d379-61c8-4690-8d9c-b19191dc25bb None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:29.858679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bbd51-0b23-4368-8789-c443bc07ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:29.859502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bbd51-0b23-4368-8789-c443bc07ec7b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.859791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bbd51-0b23-4368-8789-c443bc07ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.860074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bbd51-0b23-4368-8789-c443bc07ec7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:29.872540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bbd51-0b23-4368-8789-c443bc07ec7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-fd8bbd51-0b23-4368-8789-c443bc07ec7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:29.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:29.881198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:29.882013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 216/442] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:17:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:29.882816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bbd51-0b23-4368-8789-c443bc07ec7b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:29.957549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82d379-61c8-4690-8d9c-b19191dc25bb None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:29.987201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bbd51-0b23-4368-8789-c443bc07ec7b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:29.992593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c82ce-cf67-42eb-b244-5b0f82926b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:29.993401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c82ce-cf67-42eb-b244-5b0f82926b62 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:29.993777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c82ce-cf67-42eb-b244-5b0f82926b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:29.994399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c82ce-cf67-42eb-b244-5b0f82926b62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.020839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607a775-f38d-4092-ab48-d7a0cd1da0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:30.021538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607a775-f38d-4092-ab48-d7a0cd1da0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:30.022491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607a775-f38d-4092-ab48-d7a0cd1da0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:30.022491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607a775-f38d-4092-ab48-d7a0cd1da0b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.059935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c82ce-cf67-42eb-b244-5b0f82926b62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.061426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c82ce-cf67-42eb-b244-5b0f82926b62 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.091536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607a775-f38d-4092-ab48-d7a0cd1da0b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.093014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607a775-f38d-4092-ab48-d7a0cd1da0b3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.181639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 227/443] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:30.182527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c82ce-cf67-42eb-b244-5b0f82926b62 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:30.197743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 217/444] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:30.198585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607a775-f38d-4092-ab48-d7a0cd1da0b3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:30.282283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c82ce-cf67-42eb-b244-5b0f82926b62 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:30.299631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607a775-f38d-4092-ab48-d7a0cd1da0b3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:30.315419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c081b2-2cdb-4195-b514-c26862c3dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:30.316094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c081b2-2cdb-4195-b514-c26862c3dad7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:30.316382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c081b2-2cdb-4195-b514-c26862c3dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:30.316663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c081b2-2cdb-4195-b514-c26862c3dad7 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.317454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c081b2-2cdb-4195-b514-c26862c3dad7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:30.317847 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c081b2-2cdb-4195-b514-c26862c3dad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.319239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c081b2-2cdb-4195-b514-c26862c3dad7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.328461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 228/445] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:30.329312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c081b2-2cdb-4195-b514-c26862c3dad7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:30.337877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d878ba7-839c-4728-a400-7df102d3e6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:30.338750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d878ba7-839c-4728-a400-7df102d3e6bf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:30.339035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d878ba7-839c-4728-a400-7df102d3e6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:30.339312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d878ba7-839c-4728-a400-7df102d3e6bf None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.340532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d878ba7-839c-4728-a400-7df102d3e6bf None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.342006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d878ba7-839c-4728-a400-7df102d3e6bf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.343884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 218/446] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:30 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:30.344471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d878ba7-839c-4728-a400-7df102d3e6bf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:30.443166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c081b2-2cdb-4195-b514-c26862c3dad7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:30.446351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d878ba7-839c-4728-a400-7df102d3e6bf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:30.477853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55384fc-7dc9-4798-a81b-6257a58143d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:30.478723 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55384fc-7dc9-4798-a81b-6257a58143d4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:30.479024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55384fc-7dc9-4798-a81b-6257a58143d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:30.479300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55384fc-7dc9-4798-a81b-6257a58143d4 None admin] PATH_INFO: `/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.480535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55384fc-7dc9-4798-a81b-6257a58143d4 None admin] RBAC: Authorizing `identity:get_project(project_id=3f90d24e2c4a4d5b8db7ad50df1c2598)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.480946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3918e63-0d6e-4945-8e44-7b25a65128ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:30.481636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3918e63-0d6e-4945-8e44-7b25a65128ac None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:30.481920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3918e63-0d6e-4945-8e44-7b25a65128ac None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:30.482008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55384fc-7dc9-4798-a81b-6257a58143d4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.482194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3918e63-0d6e-4945-8e44-7b25a65128ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.483691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 229/447] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:30 2022] GET /identity/v3/projects/3f90d24e2c4a4d5b8db7ad50df1c2598 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:30.484463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55384fc-7dc9-4798-a81b-6257a58143d4 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:30.557179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3918e63-0d6e-4945-8e44-7b25a65128ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.558605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3918e63-0d6e-4945-8e44-7b25a65128ac None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.603200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55384fc-7dc9-4798-a81b-6257a58143d4 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:30.635987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8891ae9-e4a2-4b95-a2ba-3afaccadc81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:30.636843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891ae9-e4a2-4b95-a2ba-3afaccadc81d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:30.637128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891ae9-e4a2-4b95-a2ba-3afaccadc81d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:30.637439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891ae9-e4a2-4b95-a2ba-3afaccadc81d None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.638636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8891ae9-e4a2-4b95-a2ba-3afaccadc81d None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.640081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8891ae9-e4a2-4b95-a2ba-3afaccadc81d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.641761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 230/448] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:30 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:30.642533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8891ae9-e4a2-4b95-a2ba-3afaccadc81d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:30.666179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 219/449] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:30.667305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3918e63-0d6e-4945-8e44-7b25a65128ac None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:30.749082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8891ae9-e4a2-4b95-a2ba-3afaccadc81d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:30.766509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3918e63-0d6e-4945-8e44-7b25a65128ac None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:30.786840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08988a80-f001-4c66-9d02-3ee2df379fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:30.787692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08988a80-f001-4c66-9d02-3ee2df379fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:30.787976 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08988a80-f001-4c66-9d02-3ee2df379fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:30.788253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08988a80-f001-4c66-9d02-3ee2df379fb4 None admin] PATH_INFO: `/v3/groups/da86f25140dd4e8490302ac941bf3de6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.789505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08988a80-f001-4c66-9d02-3ee2df379fb4 None admin] RBAC: Authorizing `identity:get_group(group_id=da86f25140dd4e8490302ac941bf3de6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.790952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08988a80-f001-4c66-9d02-3ee2df379fb4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.792565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 231/450] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:30 2022] GET /identity/v3/groups/da86f25140dd4e8490302ac941bf3de6 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:30.793329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08988a80-f001-4c66-9d02-3ee2df379fb4 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:30.801368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71645ddf-8fa2-403d-888e-b7b3f9b9fb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:30.802055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71645ddf-8fa2-403d-888e-b7b3f9b9fb94 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:30.802321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71645ddf-8fa2-403d-888e-b7b3f9b9fb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:30.802601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71645ddf-8fa2-403d-888e-b7b3f9b9fb94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.803493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71645ddf-8fa2-403d-888e-b7b3f9b9fb94 None admin] RBAC: Adding query filter params (group.id=da86f25140dd4e8490302ac941bf3de6, role.id=2f9013fc95d448a5b605f539fb6ae08f, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:30.803807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71645ddf-8fa2-403d-888e-b7b3f9b9fb94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.805981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71645ddf-8fa2-403d-888e-b7b3f9b9fb94 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.812531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 220/451] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 12 20:17:30 2022] GET /identity/v3/role_assignments?group.id=da86f25140dd4e8490302ac941bf3de6&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=2f9013fc95d448a5b605f539fb6ae08f => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:30.813129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71645ddf-8fa2-403d-888e-b7b3f9b9fb94 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:30.926756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08988a80-f001-4c66-9d02-3ee2df379fb4 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:30.927975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71645ddf-8fa2-403d-888e-b7b3f9b9fb94 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:30.973452 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85984442-d58f-4361-a18f-08c873e1b49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:30.980209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85984442-d58f-4361-a18f-08c873e1b49a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:30.980209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85984442-d58f-4361-a18f-08c873e1b49a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:30.980209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85984442-d58f-4361-a18f-08c873e1b49a None admin] PATH_INFO: `/v3/projects/023813922bcf4863880d01ff0f27548c` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.980209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85984442-d58f-4361-a18f-08c873e1b49a None admin] RBAC: Authorizing `identity:get_project(project_id=023813922bcf4863880d01ff0f27548c)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.980500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d35b56-c70c-4bd4-a33a-79faa56c9aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:30.980500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d35b56-c70c-4bd4-a33a-79faa56c9aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:30.980500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d35b56-c70c-4bd4-a33a-79faa56c9aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:30.980500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d35b56-c70c-4bd4-a33a-79faa56c9aa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:30.980764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85984442-d58f-4361-a18f-08c873e1b49a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.980831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d35b56-c70c-4bd4-a33a-79faa56c9aa1 None admin] RBAC: Adding query filter params (group.id=da86f25140dd4e8490302ac941bf3de6, role.id=4982f0e43bc8430d81d3906431eff62e, scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:30.980831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d35b56-c70c-4bd4-a33a-79faa56c9aa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:30.980962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 232/452] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:17:30 2022] GET /identity/v3/projects/023813922bcf4863880d01ff0f27548c => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:30.981028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d35b56-c70c-4bd4-a33a-79faa56c9aa1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:30.985497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85984442-d58f-4361-a18f-08c873e1b49a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:30.987860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 221/453] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 12 20:17:30 2022] GET /identity/v3/role_assignments?group.id=da86f25140dd4e8490302ac941bf3de6&scope.project.id=3f90d24e2c4a4d5b8db7ad50df1c2598&role.id=4982f0e43bc8430d81d3906431eff62e => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:31.114403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85984442-d58f-4361-a18f-08c873e1b49a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:31.156130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95f039-93df-4f1a-9b38-eda94ee6cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:31.157011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95f039-93df-4f1a-9b38-eda94ee6cb18 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:31.157325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95f039-93df-4f1a-9b38-eda94ee6cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:31.157608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95f039-93df-4f1a-9b38-eda94ee6cb18 None admin] PATH_INFO: `/v3/groups/47071494484c4788a79d8652a57fa0fd` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:31.158898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95f039-93df-4f1a-9b38-eda94ee6cb18 None admin] RBAC: Authorizing `identity:get_group(group_id=47071494484c4788a79d8652a57fa0fd)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:31.160378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95f039-93df-4f1a-9b38-eda94ee6cb18 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:31.162108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 233/454] 10.222.0.59 () {56 vars in 1180 bytes} [Thu May 12 20:17:30 2022] GET /identity/v3/groups/47071494484c4788a79d8652a57fa0fd => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:31.171400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d35b56-c70c-4bd4-a33a-79faa56c9aa1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:31.283594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d35b56-c70c-4bd4-a33a-79faa56c9aa1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:31.318543 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222207c1-d6d0-4437-916f-da1ead040a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:31.319216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222207c1-d6d0-4437-916f-da1ead040a55 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:31.319504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222207c1-d6d0-4437-916f-da1ead040a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:31.319785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222207c1-d6d0-4437-916f-da1ead040a55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:31.320887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222207c1-d6d0-4437-916f-da1ead040a55 None admin] RBAC: Adding query filter params (group.id=47071494484c4788a79d8652a57fa0fd, role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=023813922bcf4863880d01ff0f27548c) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:31.321203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222207c1-d6d0-4437-916f-da1ead040a55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:31.322680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222207c1-d6d0-4437-916f-da1ead040a55 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:31.329186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 222/455] 10.222.0.59 () {56 vars in 1376 bytes} [Thu May 12 20:17:31 2022] GET /identity/v3/role_assignments?group.id=47071494484c4788a79d8652a57fa0fd&scope.project.id=023813922bcf4863880d01ff0f27548c&role.id=4ae0665802b946be870ab06274297a1d => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:34.190851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d255961-1ab4-4879-85a6-f22de035d011 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:34.191349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d255961-1ab4-4879-85a6-f22de035d011 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:34.191658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d255961-1ab4-4879-85a6-f22de035d011 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:34.194316 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 234/456] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:34.201102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac2e7-8585-4fa0-9047-50a51517a10d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:34.201838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac2e7-8585-4fa0-9047-50a51517a10d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:34.202111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac2e7-8585-4fa0-9047-50a51517a10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:34.238848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d19ac2e7-8585-4fa0-9047-50a51517a10d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:34.240729 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d19ac2e7-8585-4fa0-9047-50a51517a10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:34.364972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 223/457] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:34.404235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d255961-1ab4-4879-85a6-f22de035d011 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:34.559905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d255961-1ab4-4879-85a6-f22de035d011 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:34.596099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c31057-973f-46cd-8649-ac34fd43eb26 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:34.596601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c31057-973f-46cd-8649-ac34fd43eb26 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:34.597458 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c31057-973f-46cd-8649-ac34fd43eb26 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:34.600583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 224/458] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:34.612655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045866f-0908-4502-9daf-e030d0fd2b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:34.613489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045866f-0908-4502-9daf-e030d0fd2b32 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:34.613773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045866f-0908-4502-9daf-e030d0fd2b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:34.614038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045866f-0908-4502-9daf-e030d0fd2b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:34.624346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e955e-befd-4880-b81e-0e960896e481 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:34.625243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e955e-befd-4880-b81e-0e960896e481 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:34.626023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e955e-befd-4880-b81e-0e960896e481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:34.637620 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045866f-0908-4502-9daf-e030d0fd2b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:34.640696 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045866f-0908-4502-9daf-e030d0fd2b32 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:34.681650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e12e955e-befd-4880-b81e-0e960896e481 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:34.684633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e12e955e-befd-4880-b81e-0e960896e481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-d045866f-0908-4502-9daf-e030d0fd2b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:34.716140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:34.718159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:34.719648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:34.719648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:34.719648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:34.719648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:34.726553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 235/459] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:34.732799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045866f-0908-4502-9daf-e030d0fd2b32 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:34.897202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 225/460] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:34.899310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da947f3-5a53-4d33-b077-4f2f8827185e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:34.899769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da947f3-5a53-4d33-b077-4f2f8827185e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:34.900176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da947f3-5a53-4d33-b077-4f2f8827185e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:34.901945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 226/461] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:34.910563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e70ab0-4dd2-4656-9ef4-08afdbfa2438 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:34.910857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e70ab0-4dd2-4656-9ef4-08afdbfa2438 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:34.911148 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e70ab0-4dd2-4656-9ef4-08afdbfa2438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:34.942296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d9e70ab0-4dd2-4656-9ef4-08afdbfa2438 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:34.943770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d9e70ab0-4dd2-4656-9ef4-08afdbfa2438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:34.962374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045866f-0908-4502-9daf-e030d0fd2b32 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:34.999096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd77ef8-f62c-4b3d-9606-eef950944af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:35.000046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77ef8-f62c-4b3d-9606-eef950944af2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.000501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77ef8-f62c-4b3d-9606-eef950944af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.000916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77ef8-f62c-4b3d-9606-eef950944af2 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:35.001827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd77ef8-f62c-4b3d-9606-eef950944af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:35.002279 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd77ef8-f62c-4b3d-9606-eef950944af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:35.003816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd77ef8-f62c-4b3d-9606-eef950944af2 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:35.029077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 227/462] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:35.030212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e70ab0-4dd2-4656-9ef4-08afdbfa2438 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:35.047527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 236/463] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:35.055029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd77ef8-f62c-4b3d-9606-eef950944af2 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:35.156084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e70ab0-4dd2-4656-9ef4-08afdbfa2438 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:35.193336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426eed5-3858-41a3-b192-74d3665601b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:35.194151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426eed5-3858-41a3-b192-74d3665601b5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.194437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426eed5-3858-41a3-b192-74d3665601b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.194714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426eed5-3858-41a3-b192-74d3665601b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:35.206068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426eed5-3858-41a3-b192-74d3665601b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:35.207454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426eed5-3858-41a3-b192-74d3665601b5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:35.218377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd77ef8-f62c-4b3d-9606-eef950944af2 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c426eed5-3858-41a3-b192-74d3665601b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:35.229441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:35.230420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:35.231256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:35.231256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:35.231256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:35.231256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:35.231813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 228/464] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:35.234316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fba39-2b8a-4e49-832f-99ac6e8957f9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.234840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fba39-2b8a-4e49-832f-99ac6e8957f9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.235253 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fba39-2b8a-4e49-832f-99ac6e8957f9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:35.236684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 229/465] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:35.241310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fba39-2b8a-4e49-832f-99ac6e8957f9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:35.261921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f6b1-fa24-42f7-b6f3-7514deaf57f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:35.262599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f6b1-fa24-42f7-b6f3-7514deaf57f7 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.262884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f6b1-fa24-42f7-b6f3-7514deaf57f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.263457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f6b1-fa24-42f7-b6f3-7514deaf57f7 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:35.263864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6f6b1-fa24-42f7-b6f3-7514deaf57f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:35.265384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6f6b1-fa24-42f7-b6f3-7514deaf57f7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:35.344072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fba39-2b8a-4e49-832f-99ac6e8957f9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:35.365315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 237/466] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:17:35 2022] POST /identity/v3/users => generated 246 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:17:35.365315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f6b1-fa24-42f7-b6f3-7514deaf57f7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:35.407324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d71f27-f822-4922-a07f-4e1a1e87e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:35.408740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d71f27-f822-4922-a07f-4e1a1e87e802 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.409655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d71f27-f822-4922-a07f-4e1a1e87e802 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d71f27-f822-4922-a07f-4e1a1e87e802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:35.431802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d71f27-f822-4922-a07f-4e1a1e87e802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:35.434547 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d71f27-f822-4922-a07f-4e1a1e87e802 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-38d71f27-f822-4922-a07f-4e1a1e87e802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:35.473041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:35.473980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:35.474831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:35.474831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:35.474831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:35.474831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:35.476188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 230/467] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:35.483903 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b598-eead-4b45-9906-4ae0b8f75500 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.484268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b598-eead-4b45-9906-4ae0b8f75500 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.484637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b598-eead-4b45-9906-4ae0b8f75500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:35.511322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-cd37b598-eead-4b45-9906-4ae0b8f75500 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:35.512728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cd37b598-eead-4b45-9906-4ae0b8f75500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:35.536921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f6b1-fa24-42f7-b6f3-7514deaf57f7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:35.579992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308b937-0847-451f-8e6d-c8db6cacb8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:35.580985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308b937-0847-451f-8e6d-c8db6cacb8fb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.581518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308b937-0847-451f-8e6d-c8db6cacb8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.582016 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308b937-0847-451f-8e6d-c8db6cacb8fb None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:35.583006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308b937-0847-451f-8e6d-c8db6cacb8fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:35.583490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308b937-0847-451f-8e6d-c8db6cacb8fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:35.585120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308b937-0847-451f-8e6d-c8db6cacb8fb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:35.601453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 238/468] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:35.606625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308b937-0847-451f-8e6d-c8db6cacb8fb None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:35.612925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 231/469] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:35.618410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b598-eead-4b45-9906-4ae0b8f75500 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:35.759085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308b937-0847-451f-8e6d-c8db6cacb8fb None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:35.762659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b598-eead-4b45-9906-4ae0b8f75500 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:35.802516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e49c59-96d5-4606-a844-6658fdc3a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:35.803182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189a845-3bad-42eb-b20f-69decb508cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:35.803310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e49c59-96d5-4606-a844-6658fdc3a11f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.803463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e49c59-96d5-4606-a844-6658fdc3a11f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.803740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e49c59-96d5-4606-a844-6658fdc3a11f None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:35.803859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189a845-3bad-42eb-b20f-69decb508cf1 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.804147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189a845-3bad-42eb-b20f-69decb508cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.804452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189a845-3bad-42eb-b20f-69decb508cf1 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:35.805110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e49c59-96d5-4606-a844-6658fdc3a11f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:35.805218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189a845-3bad-42eb-b20f-69decb508cf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:35.805460 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e49c59-96d5-4606-a844-6658fdc3a11f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:35.806716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189a845-3bad-42eb-b20f-69decb508cf1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:35.806887 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e49c59-96d5-4606-a844-6658fdc3a11f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:35.822717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 239/470] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:35.823587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e49c59-96d5-4606-a844-6658fdc3a11f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:35.928065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 232/471] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:17:35 2022] POST /identity/v3/users => generated 248 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:17:35.930127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e925ba-a0e7-4a3e-9857-62ffff38ef61 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.930577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e925ba-a0e7-4a3e-9857-62ffff38ef61 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.930910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e925ba-a0e7-4a3e-9857-62ffff38ef61 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:35.932584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 233/472] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:35.936396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e925ba-a0e7-4a3e-9857-62ffff38ef61 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:35.950864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e49c59-96d5-4606-a844-6658fdc3a11f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:35.992691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad7973-cf16-4b83-9dfa-8a49b382dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:35.993681 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad7973-cf16-4b83-9dfa-8a49b382dd7e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:35.993988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad7973-cf16-4b83-9dfa-8a49b382dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:35.994562 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad7973-cf16-4b83-9dfa-8a49b382dd7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:36.011320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad7973-cf16-4b83-9dfa-8a49b382dd7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:36.013186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad7973-cf16-4b83-9dfa-8a49b382dd7e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-6dad7973-cf16-4b83-9dfa-8a49b382dd7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:36.033561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:36.034682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:36.035754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:36.035754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:36.035754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:36.035754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:36.042688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 240/473] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:36.044518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7e9f1-5e2a-498d-b5ef-bea3b6693e80 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:36.044959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7e9f1-5e2a-498d-b5ef-bea3b6693e80 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:36.045403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7e9f1-5e2a-498d-b5ef-bea3b6693e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:36.064701 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a3c7e9f1-5e2a-498d-b5ef-bea3b6693e80 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:36.066199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a3c7e9f1-5e2a-498d-b5ef-bea3b6693e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:36.102901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e925ba-a0e7-4a3e-9857-62ffff38ef61 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:36.140727 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfb936-7b48-4083-a162-e87f1856f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:36.141627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfb936-7b48-4083-a162-e87f1856f3c6 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:36.142014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfb936-7b48-4083-a162-e87f1856f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:36.142415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfb936-7b48-4083-a162-e87f1856f3c6 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:36.143250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfb936-7b48-4083-a162-e87f1856f3c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:36.144805 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfb936-7b48-4083-a162-e87f1856f3c6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:36.153713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 241/474] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:36.155157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7e9f1-5e2a-498d-b5ef-bea3b6693e80 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:36.256293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 234/475] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:17:35 2022] POST /identity/v3/users => generated 248 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:17:36.257208 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfb936-7b48-4083-a162-e87f1856f3c6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:36.264885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7e9f1-5e2a-498d-b5ef-bea3b6693e80 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:36.318528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f98216-40ba-4f2e-9f84-a6154037b026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:36.319665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f98216-40ba-4f2e-9f84-a6154037b026 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:36.320760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f98216-40ba-4f2e-9f84-a6154037b026 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:36.321256 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f98216-40ba-4f2e-9f84-a6154037b026 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:36.322287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f98216-40ba-4f2e-9f84-a6154037b026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:36.322840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f98216-40ba-4f2e-9f84-a6154037b026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:36.324697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f98216-40ba-4f2e-9f84-a6154037b026 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:36.338489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 242/476] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:36.345190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f98216-40ba-4f2e-9f84-a6154037b026 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:36.451664 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfb936-7b48-4083-a162-e87f1856f3c6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:36.469668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f98216-40ba-4f2e-9f84-a6154037b026 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:36.508655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279520d9-7461-4abe-a3e6-382dea7a0772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:36.509383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279520d9-7461-4abe-a3e6-382dea7a0772 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:36.509676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279520d9-7461-4abe-a3e6-382dea7a0772 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:36.509958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279520d9-7461-4abe-a3e6-382dea7a0772 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:36.511456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279520d9-7461-4abe-a3e6-382dea7a0772 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:36.512305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279520d9-7461-4abe-a3e6-382dea7a0772 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:36.513678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307df5e-8972-46a9-9d52-f2cc2bfa207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:36.514603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307df5e-8972-46a9-9d52-f2cc2bfa207a None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:36.515140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307df5e-8972-46a9-9d52-f2cc2bfa207a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:36.515664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307df5e-8972-46a9-9d52-f2cc2bfa207a None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:36.516674 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307df5e-8972-46a9-9d52-f2cc2bfa207a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:36.518412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307df5e-8972-46a9-9d52-f2cc2bfa207a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:36.554269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.sql.core [None req-279520d9-7461-4abe-a3e6-382dea7a0772 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 20:17:36.554269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 20:17:36.554269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [parameters: {'id': '7cb32197dbaf450aa14de635c4feeab6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 20:17:36.554269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80202) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-279520d9-7461-4abe-a3e6-382dea7a0772 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application result = self._query(query) May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application conn.query(q) May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application result.read() May 12 20:17:36.571589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return ref.to_dict() May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 20:17:36.576968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application next(self.gen) May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application yield resource May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application next(self.gen) May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self.session.rollback() May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self.force_reraise() May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise self.value May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application session.commit() May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 20:17:36.578061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._prepare_impl() May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self.session.flush() May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._flush(objects) May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application compat.raise_( May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application flush_context.execute() May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rec.execute(self) May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 20:17:36.578935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 20:17:36.579763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application result = self._query(query) May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application conn.query(q) May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application result.read() May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 20:17:36.580548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [parameters: {'id': '7cb32197dbaf450aa14de635c4feeab6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:36.581859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 20:17:36.583158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:36.584713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 235/477] 10.222.0.59 () {60 vars in 1131 bytes} [Thu May 12 20:17:36 2022] POST /identity/v3/roles => generated 144 bytes in 316 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:36.584713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279520d9-7461-4abe-a3e6-382dea7a0772 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:36.635814 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 243/478] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:17:36 2022] POST /identity/v3/users => generated 249 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:17:36.700578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279520d9-7461-4abe-a3e6-382dea7a0772 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:36.743961 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce5b71-8bb4-4fd6-a98c-d0db016b7902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:36.745083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5b71-8bb4-4fd6-a98c-d0db016b7902 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:36.745437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5b71-8bb4-4fd6-a98c-d0db016b7902 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:36.745716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5b71-8bb4-4fd6-a98c-d0db016b7902 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:36.769873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce5b71-8bb4-4fd6-a98c-d0db016b7902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ebce5b71-8bb4-4fd6-a98c-d0db016b7902 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:36.778452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:36.779435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:36.780230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 236/479] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:17:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:36.786980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307df5e-8972-46a9-9d52-f2cc2bfa207a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:36.933487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307df5e-8972-46a9-9d52-f2cc2bfa207a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:36.975057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142b34f-df2b-4769-93aa-5b20664e3617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:36.976999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142b34f-df2b-4769-93aa-5b20664e3617 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:36.976999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142b34f-df2b-4769-93aa-5b20664e3617 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:36.976999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142b34f-df2b-4769-93aa-5b20664e3617 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:36.977589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142b34f-df2b-4769-93aa-5b20664e3617 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:36.977838 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142b34f-df2b-4769-93aa-5b20664e3617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:36.979238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142b34f-df2b-4769-93aa-5b20664e3617 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:36.990147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 244/480] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:38.168067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c02d2-0a6b-4a4f-b4e7-30ff3077e999 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:38.168575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c02d2-0a6b-4a4f-b4e7-30ff3077e999 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:38.168575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c02d2-0a6b-4a4f-b4e7-30ff3077e999 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:38.170183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 237/481] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:38.175197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2621906-c847-4f4e-8136-72a2a4cc228d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:38.175595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2621906-c847-4f4e-8136-72a2a4cc228d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:38.175863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2621906-c847-4f4e-8136-72a2a4cc228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:38.197701 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-b2621906-c847-4f4e-8136-72a2a4cc228d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:38.198900 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b2621906-c847-4f4e-8136-72a2a4cc228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:38.268146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 245/482] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:38.302889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c02d2-0a6b-4a4f-b4e7-30ff3077e999 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:38.443357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c02d2-0a6b-4a4f-b4e7-30ff3077e999 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:38.491297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01745168-da67-43a9-a0f5-91e258a864d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:38.492396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01745168-da67-43a9-a0f5-91e258a864d1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:38.493514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01745168-da67-43a9-a0f5-91e258a864d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:38.493949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01745168-da67-43a9-a0f5-91e258a864d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:38.512376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01745168-da67-43a9-a0f5-91e258a864d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-01745168-da67-43a9-a0f5-91e258a864d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:38.520728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:38.521890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:38.523494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:38.525793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 238/483] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:38.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2621906-c847-4f4e-8136-72a2a4cc228d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:38.663664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2621906-c847-4f4e-8136-72a2a4cc228d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:38.700959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08e47c-b75b-4fb9-9fef-0e8555d4cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:38.701595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08e47c-b75b-4fb9-9fef-0e8555d4cf65 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:38.701887 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08e47c-b75b-4fb9-9fef-0e8555d4cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:38.702170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08e47c-b75b-4fb9-9fef-0e8555d4cf65 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:38.702945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08e47c-b75b-4fb9-9fef-0e8555d4cf65 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:38.703257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08e47c-b75b-4fb9-9fef-0e8555d4cf65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:38.704638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08e47c-b75b-4fb9-9fef-0e8555d4cf65 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:38.714347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 246/484] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:38.719475 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01745168-da67-43a9-a0f5-91e258a864d1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:38.845338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01745168-da67-43a9-a0f5-91e258a864d1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:38.904410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c3d51-7f23-421a-b2f9-db5ad366bd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:38.905225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c3d51-7f23-421a-b2f9-db5ad366bd4d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:38.905534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c3d51-7f23-421a-b2f9-db5ad366bd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:38.905813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c3d51-7f23-421a-b2f9-db5ad366bd4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:38.922523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c3d51-7f23-421a-b2f9-db5ad366bd4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:38.923999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c3d51-7f23-421a-b2f9-db5ad366bd4d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-fc4c3d51-7f23-421a-b2f9-db5ad366bd4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:38.946800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:38.947697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:38.948518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:38.948518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:38.948518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:38.948518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:38.952515 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 239/485] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:38.953496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08e47c-b75b-4fb9-9fef-0e8555d4cf65 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:39.065373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c64fcf-8f1f-4a9f-9dac-be32d43b57bb None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.065373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c64fcf-8f1f-4a9f-9dac-be32d43b57bb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.065373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c64fcf-8f1f-4a9f-9dac-be32d43b57bb None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.066105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 240/486] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:17:39.073962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd020f98-b3e8-4ebc-91ec-03bf135988e0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.074831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd020f98-b3e8-4ebc-91ec-03bf135988e0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.075507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd020f98-b3e8-4ebc-91ec-03bf135988e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.076502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08e47c-b75b-4fb9-9fef-0e8555d4cf65 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:39.116427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fd020f98-b3e8-4ebc-91ec-03bf135988e0 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:39.119531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fd020f98-b3e8-4ebc-91ec-03bf135988e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:39.121746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568848c-c0f3-4931-bdc8-9ae15c4610a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:39.122485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568848c-c0f3-4931-bdc8-9ae15c4610a2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.122780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568848c-c0f3-4931-bdc8-9ae15c4610a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.123066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568848c-c0f3-4931-bdc8-9ae15c4610a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.123990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568848c-c0f3-4931-bdc8-9ae15c4610a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:39.124152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568848c-c0f3-4931-bdc8-9ae15c4610a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:39.126639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568848c-c0f3-4931-bdc8-9ae15c4610a2 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:39.140168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 247/487] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:39.141732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03610e12-4b3b-452b-8223-d03e1d1c9aa9 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.142029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03610e12-4b3b-452b-8223-d03e1d1c9aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.142311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03610e12-4b3b-452b-8223-d03e1d1c9aa9 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.143589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 248/488] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:39.148788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03610e12-4b3b-452b-8223-d03e1d1c9aa9 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:39.222689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 241/489] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:39.224015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c66da9-46dd-48f6-911e-51eff9dd0a6d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.224313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c66da9-46dd-48f6-911e-51eff9dd0a6d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.224601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c66da9-46dd-48f6-911e-51eff9dd0a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.245775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-57c66da9-46dd-48f6-911e-51eff9dd0a6d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:39.246981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-57c66da9-46dd-48f6-911e-51eff9dd0a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:39.298662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03610e12-4b3b-452b-8223-d03e1d1c9aa9 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:39.337377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 242/490] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:39.338708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c66da9-46dd-48f6-911e-51eff9dd0a6d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:39.355713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a8ad8-4eec-4b4b-8454-f5673eebdfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:39.357026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a8ad8-4eec-4b4b-8454-f5673eebdfef None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.357556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a8ad8-4eec-4b4b-8454-f5673eebdfef None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.358048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a8ad8-4eec-4b4b-8454-f5673eebdfef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.371328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a8ad8-4eec-4b4b-8454-f5673eebdfef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:39.373842 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a8ad8-4eec-4b4b-8454-f5673eebdfef None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-fe1a8ad8-4eec-4b4b-8454-f5673eebdfef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:39.394990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:39.395967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:39.397132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:39.397132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:39.397132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:39.397132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:39.397132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:39.397132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:39.397132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:39.397132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:39.397132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 20:17:39.397132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:39.399769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 249/491] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 12 20:17:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:39.402434 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a8ad8-4eec-4b4b-8454-f5673eebdfef None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:39.477532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c66da9-46dd-48f6-911e-51eff9dd0a6d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:39.520763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39335989-4f09-472d-b9c0-0557e198693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:39.522014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39335989-4f09-472d-b9c0-0557e198693f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.522308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39335989-4f09-472d-b9c0-0557e198693f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.522593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39335989-4f09-472d-b9c0-0557e198693f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.537389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39335989-4f09-472d-b9c0-0557e198693f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:39.543975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a8ad8-4eec-4b4b-8454-f5673eebdfef None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-39335989-4f09-472d-b9c0-0557e198693f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:39.546733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:39.547613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:39.548399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:39.551184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 243/492] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:39.552213 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39335989-4f09-472d-b9c0-0557e198693f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:39.581891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd80813-2f7f-4c48-add3-22e855e6a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:39.582738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd80813-2f7f-4c48-add3-22e855e6a408 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.583029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd80813-2f7f-4c48-add3-22e855e6a408 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.583318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd80813-2f7f-4c48-add3-22e855e6a408 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.596603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd80813-2f7f-4c48-add3-22e855e6a408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-3bd80813-2f7f-4c48-add3-22e855e6a408 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:39.604917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:39.606389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:39.607173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:39.610931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 250/493] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:39.611876 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd80813-2f7f-4c48-add3-22e855e6a408 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:39.668685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39335989-4f09-472d-b9c0-0557e198693f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:39.705677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bb609-4f37-45b6-a02e-32be50197106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:39.706901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bb609-4f37-45b6-a02e-32be50197106 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.707385 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bb609-4f37-45b6-a02e-32be50197106 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.707852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bb609-4f37-45b6-a02e-32be50197106 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.708969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bb609-4f37-45b6-a02e-32be50197106 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:39.709506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bb609-4f37-45b6-a02e-32be50197106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:39.712204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bb609-4f37-45b6-a02e-32be50197106 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:39.718862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd80813-2f7f-4c48-add3-22e855e6a408 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:39.754933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9aeb3-e05c-4776-9e06-6d2c2aa09718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:39.755541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9aeb3-e05c-4776-9e06-6d2c2aa09718 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.755831 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9aeb3-e05c-4776-9e06-6d2c2aa09718 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.756170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9aeb3-e05c-4776-9e06-6d2c2aa09718 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.756875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9aeb3-e05c-4776-9e06-6d2c2aa09718 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:39.757246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9aeb3-e05c-4776-9e06-6d2c2aa09718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:39.758875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9aeb3-e05c-4776-9e06-6d2c2aa09718 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:39.759820 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 244/494] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 12 20:17:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:39.761002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bb609-4f37-45b6-a02e-32be50197106 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:39.768518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 251/495] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:39.769510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9aeb3-e05c-4776-9e06-6d2c2aa09718 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:39.871542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bb609-4f37-45b6-a02e-32be50197106 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:39.874956 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9aeb3-e05c-4776-9e06-6d2c2aa09718 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:39.911364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9de58-a4d8-466e-bebc-70dcda4b1591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:39.911817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab2026-4633-4790-97b9-89990fd628cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:39.912392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9de58-a4d8-466e-bebc-70dcda4b1591 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.912494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab2026-4633-4790-97b9-89990fd628cf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.912766 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab2026-4633-4790-97b9-89990fd628cf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.912860 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9de58-a4d8-466e-bebc-70dcda4b1591 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.913038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab2026-4633-4790-97b9-89990fd628cf None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.913209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9de58-a4d8-466e-bebc-70dcda4b1591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.914685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab2026-4633-4790-97b9-89990fd628cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:39.915165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab2026-4633-4790-97b9-89990fd628cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:39.916566 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab2026-4633-4790-97b9-89990fd628cf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:39.932060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 245/496] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:39.932060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda4ab5-7b24-4240-bd0c-9279ddd2ccaf None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:39.932060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda4ab5-7b24-4240-bd0c-9279ddd2ccaf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:39.932060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda4ab5-7b24-4240-bd0c-9279ddd2ccaf None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:39.932060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 246/497] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:39.933042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda4ab5-7b24-4240-bd0c-9279ddd2ccaf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:39.997085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9de58-a4d8-466e-bebc-70dcda4b1591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:39.998793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9de58-a4d8-466e-bebc-70dcda4b1591 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:40.045780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda4ab5-7b24-4240-bd0c-9279ddd2ccaf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:40.082060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13703f-b8dd-4de4-9676-d3f7f6774ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:40.082866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13703f-b8dd-4de4-9676-d3f7f6774ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.083153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13703f-b8dd-4de4-9676-d3f7f6774ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.083432 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13703f-b8dd-4de4-9676-d3f7f6774ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.094021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13703f-b8dd-4de4-9676-d3f7f6774ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:40.095469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13703f-b8dd-4de4-9676-d3f7f6774ca0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:40.103904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 252/498] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:40.104750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9de58-a4d8-466e-bebc-70dcda4b1591 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-1f13703f-b8dd-4de4-9676-d3f7f6774ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:40.114183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:40.115202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:40.116098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:40.116098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:40.116098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:40.116098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:40.116098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 247/499] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:40.117112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003459fd-509b-41d0-8b7d-1f25beebe314 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.117575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003459fd-509b-41d0-8b7d-1f25beebe314 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.117864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003459fd-509b-41d0-8b7d-1f25beebe314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.135786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-003459fd-509b-41d0-8b7d-1f25beebe314 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:40.136984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-003459fd-509b-41d0-8b7d-1f25beebe314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:40.201877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 248/500] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:40.202353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9de58-a4d8-466e-bebc-70dcda4b1591 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:40.203251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568fb03-e47d-48c7-bfb6-bdc9e7481e12 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.203495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568fb03-e47d-48c7-bfb6-bdc9e7481e12 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.203776 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568fb03-e47d-48c7-bfb6-bdc9e7481e12 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.205042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 249/501] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:40.205785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568fb03-e47d-48c7-bfb6-bdc9e7481e12 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:40.246125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa41739-a1a7-462d-abb1-92cf48a6dccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:40.246854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa41739-a1a7-462d-abb1-92cf48a6dccc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.247165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa41739-a1a7-462d-abb1-92cf48a6dccc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.247418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa41739-a1a7-462d-abb1-92cf48a6dccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.258150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa41739-a1a7-462d-abb1-92cf48a6dccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:40.259600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa41739-a1a7-462d-abb1-92cf48a6dccc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-aaa41739-a1a7-462d-abb1-92cf48a6dccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:40.277388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:40.278273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:40.279078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:40.279078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:40.279078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:40.279078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:40.279078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 253/502] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:40.279735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa41739-a1a7-462d-abb1-92cf48a6dccc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:40.311633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568fb03-e47d-48c7-bfb6-bdc9e7481e12 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:40.348805 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199743a-a9b7-41ec-aa95-44d202ddc62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:40.349955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199743a-a9b7-41ec-aa95-44d202ddc62c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.350476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199743a-a9b7-41ec-aa95-44d202ddc62c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.350976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199743a-a9b7-41ec-aa95-44d202ddc62c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.364196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199743a-a9b7-41ec-aa95-44d202ddc62c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:40.365750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199743a-a9b7-41ec-aa95-44d202ddc62c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:40.389870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa41739-a1a7-462d-abb1-92cf48a6dccc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8199743a-a9b7-41ec-aa95-44d202ddc62c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:40.394249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:40.395060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:40.395966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:40.395966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:40.395966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:40.395966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:40.397444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 250/503] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:40.400146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f51d9-ce96-4ff1-a29c-907cc5afa1cc None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.400441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f51d9-ce96-4ff1-a29c-907cc5afa1cc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.400722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f51d9-ce96-4ff1-a29c-907cc5afa1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.418372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-185f51d9-ce96-4ff1-a29c-907cc5afa1cc None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:40.419588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-185f51d9-ce96-4ff1-a29c-907cc5afa1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:40.425896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46df04-133b-475b-8b9f-b80edece2770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:40.426557 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46df04-133b-475b-8b9f-b80edece2770 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.426840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46df04-133b-475b-8b9f-b80edece2770 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.427114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46df04-133b-475b-8b9f-b80edece2770 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.427837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46df04-133b-475b-8b9f-b80edece2770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:40.428138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46df04-133b-475b-8b9f-b80edece2770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:40.430331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46df04-133b-475b-8b9f-b80edece2770 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:40.441949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 254/504] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:40.442742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46df04-133b-475b-8b9f-b80edece2770 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:40.492246 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 251/505] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:40.493526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f51d9-ce96-4ff1-a29c-907cc5afa1cc None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:40.552404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46df04-133b-475b-8b9f-b80edece2770 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:40.587569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125757a0-3b46-4560-a0c5-5953592b00ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:40.588379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125757a0-3b46-4560-a0c5-5953592b00ba None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.588670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125757a0-3b46-4560-a0c5-5953592b00ba None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.588951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125757a0-3b46-4560-a0c5-5953592b00ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.599245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125757a0-3b46-4560-a0c5-5953592b00ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-125757a0-3b46-4560-a0c5-5953592b00ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:40.607267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:40.608181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:40.608966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:40.609601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f51d9-ce96-4ff1-a29c-907cc5afa1cc None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:40.609688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 255/506] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:40.610848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125757a0-3b46-4560-a0c5-5953592b00ba None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:40.644711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77917c5-c37a-4637-bd26-2a4a0d06a978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:40.644711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77917c5-c37a-4637-bd26-2a4a0d06a978 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.644711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77917c5-c37a-4637-bd26-2a4a0d06a978 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.644711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77917c5-c37a-4637-bd26-2a4a0d06a978 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.645170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77917c5-c37a-4637-bd26-2a4a0d06a978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:40.645170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77917c5-c37a-4637-bd26-2a4a0d06a978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:40.645752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77917c5-c37a-4637-bd26-2a4a0d06a978 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:40.657384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 252/507] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:40.658225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77917c5-c37a-4637-bd26-2a4a0d06a978 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:40.713136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125757a0-3b46-4560-a0c5-5953592b00ba None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:40.750761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b582cbd-9f29-400b-b8e9-8700098c57c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:40.751443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b582cbd-9f29-400b-b8e9-8700098c57c6 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.751727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b582cbd-9f29-400b-b8e9-8700098c57c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.752007 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b582cbd-9f29-400b-b8e9-8700098c57c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.752735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b582cbd-9f29-400b-b8e9-8700098c57c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:40.753045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b582cbd-9f29-400b-b8e9-8700098c57c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:40.754475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b582cbd-9f29-400b-b8e9-8700098c57c6 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:40.763528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77917c5-c37a-4637-bd26-2a4a0d06a978 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:40.767214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 256/508] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:40.768060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b582cbd-9f29-400b-b8e9-8700098c57c6 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:40.797921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d329a-2c79-487b-9467-59aebb4a6654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:40.798720 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d329a-2c79-487b-9467-59aebb4a6654 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.798999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d329a-2c79-487b-9467-59aebb4a6654 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.799272 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d329a-2c79-487b-9467-59aebb4a6654 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.807589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d329a-2c79-487b-9467-59aebb4a6654 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:40.809019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d329a-2c79-487b-9467-59aebb4a6654 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9e0d329a-2c79-487b-9467-59aebb4a6654 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:40.825714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:40.826650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:40.827522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 253/509] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:40.828059 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d329a-2c79-487b-9467-59aebb4a6654 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:40.869367 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b582cbd-9f29-400b-b8e9-8700098c57c6 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:40.902985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8335-7151-4647-9c59-baa7cae98ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:40.903785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8335-7151-4647-9c59-baa7cae98ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.904067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8335-7151-4647-9c59-baa7cae98ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.904339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c8335-7151-4647-9c59-baa7cae98ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.915253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c8335-7151-4647-9c59-baa7cae98ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:40.916718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c8335-7151-4647-9c59-baa7cae98ba3 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:40.939813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d329a-2c79-487b-9467-59aebb4a6654 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-697c8335-7151-4647-9c59-baa7cae98ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:40.942866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:40.943690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:40.945600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:40.945600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:40.945600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:40.945600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:40.945600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 257/510] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:40.946381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8335-7151-4647-9c59-baa7cae98ba3 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:40.989999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048aefb-0610-440c-9359-532ba89abcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:40.991057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048aefb-0610-440c-9359-532ba89abcbc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:40.992102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048aefb-0610-440c-9359-532ba89abcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:40.992480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048aefb-0610-440c-9359-532ba89abcbc None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:40.993622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048aefb-0610-440c-9359-532ba89abcbc None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:40.994394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048aefb-0610-440c-9359-532ba89abcbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:40.996787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048aefb-0610-440c-9359-532ba89abcbc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.009233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 254/511] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:41.010524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048aefb-0610-440c-9359-532ba89abcbc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:41.071288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c8335-7151-4647-9c59-baa7cae98ba3 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:41.110095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd321e7-9ff1-4789-b7cd-01e82bda9fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:41.110906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd321e7-9ff1-4789-b7cd-01e82bda9fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:41.111193 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd321e7-9ff1-4789-b7cd-01e82bda9fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:41.111474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd321e7-9ff1-4789-b7cd-01e82bda9fe1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:41.119771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd321e7-9ff1-4789-b7cd-01e82bda9fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:41.121030 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048aefb-0610-440c-9359-532ba89abcbc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:41.121191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd321e7-9ff1-4789-b7cd-01e82bda9fe1 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-afd321e7-9ff1-4789-b7cd-01e82bda9fe1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:41.137318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:41.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 258/512] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:41.139258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd321e7-9ff1-4789-b7cd-01e82bda9fe1 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:41.160628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa9c97-6406-470f-8775-c63d31c3c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:41.161472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa9c97-6406-470f-8775-c63d31c3c4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:41.161760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa9c97-6406-470f-8775-c63d31c3c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:41.162042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa9c97-6406-470f-8775-c63d31c3c4e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:41.169242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa9c97-6406-470f-8775-c63d31c3c4e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:41.170718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa9c97-6406-470f-8775-c63d31c3c4e4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b0aa9c97-6406-470f-8775-c63d31c3c4e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:41.185857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:41.186751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:41.187590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:41.187590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:41.187590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:41.187590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:41.187590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:41.187590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:41.187590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:41.187590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:41.189576 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 255/513] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:41.190266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa9c97-6406-470f-8775-c63d31c3c4e4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:41.233418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd321e7-9ff1-4789-b7cd-01e82bda9fe1 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:41.269251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dd5f0-b040-44f3-b7a7-5d163358a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:41.269947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dd5f0-b040-44f3-b7a7-5d163358a938 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:41.270236 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dd5f0-b040-44f3-b7a7-5d163358a938 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:41.270515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dd5f0-b040-44f3-b7a7-5d163358a938 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:41.271359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dd5f0-b040-44f3-b7a7-5d163358a938 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:41.271672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dd5f0-b040-44f3-b7a7-5d163358a938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:41.273155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dd5f0-b040-44f3-b7a7-5d163358a938 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.287969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa9c97-6406-470f-8775-c63d31c3c4e4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:41.308423 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 259/514] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 12 20:17:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:41.310643 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dd5f0-b040-44f3-b7a7-5d163358a938 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:41.323856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72f595-3150-41b4-a4e9-5ec89f4653fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:41.324517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72f595-3150-41b4-a4e9-5ec89f4653fe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:41.324810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72f595-3150-41b4-a4e9-5ec89f4653fe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:41.325088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72f595-3150-41b4-a4e9-5ec89f4653fe None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:41.325867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72f595-3150-41b4-a4e9-5ec89f4653fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:41.326170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72f595-3150-41b4-a4e9-5ec89f4653fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:41.327540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72f595-3150-41b4-a4e9-5ec89f4653fe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.339031 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 256/515] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:41.339844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72f595-3150-41b4-a4e9-5ec89f4653fe None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:41.416298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dd5f0-b040-44f3-b7a7-5d163358a938 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:41.436286 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72f595-3150-41b4-a4e9-5ec89f4653fe None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:41.449262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eaa9a-86e5-49d1-9f46-b3efb2850c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:41.450101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eaa9a-86e5-49d1-9f46-b3efb2850c06 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:41.450379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eaa9a-86e5-49d1-9f46-b3efb2850c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:41.450661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eaa9a-86e5-49d1-9f46-b3efb2850c06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:41.460090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2eaa9a-86e5-49d1-9f46-b3efb2850c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:41.462148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2eaa9a-86e5-49d1-9f46-b3efb2850c06 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.468133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc44bde-4520-4c48-a36a-364fcff14b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:41.468802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44bde-4520-4c48-a36a-364fcff14b3c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:41.469086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44bde-4520-4c48-a36a-364fcff14b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:41.469398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44bde-4520-4c48-a36a-364fcff14b3c None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:41.470236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc44bde-4520-4c48-a36a-364fcff14b3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:41.470546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc44bde-4520-4c48-a36a-364fcff14b3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:41.471958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc44bde-4520-4c48-a36a-364fcff14b3c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-bc2eaa9a-86e5-49d1-9f46-b3efb2850c06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:41.479257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:41.480154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:41.481002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:41.481002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:41.481002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:41.481002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:41.484896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 260/516] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:41.485689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eaa9a-86e5-49d1-9f46-b3efb2850c06 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:41.488572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 257/517] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 12 20:17:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:41.489409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc44bde-4520-4c48-a36a-364fcff14b3c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:41.580328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eaa9a-86e5-49d1-9f46-b3efb2850c06 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:41.583815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc44bde-4520-4c48-a36a-364fcff14b3c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:41.612568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aae60-1487-4eef-aefa-69a04162a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:41.613219 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aae60-1487-4eef-aefa-69a04162a385 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:41.613540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aae60-1487-4eef-aefa-69a04162a385 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:41.613812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aae60-1487-4eef-aefa-69a04162a385 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:41.614592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aae60-1487-4eef-aefa-69a04162a385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:41.614901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aae60-1487-4eef-aefa-69a04162a385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:41.616337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aae60-1487-4eef-aefa-69a04162a385 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.617204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88fc3-5d6a-40c4-880f-18be59ae4d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:41.617885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88fc3-5d6a-40c4-880f-18be59ae4d91 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:41.618175 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88fc3-5d6a-40c4-880f-18be59ae4d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:41.618459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88fc3-5d6a-40c4-880f-18be59ae4d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:41.635498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 261/518] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:41.636286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aae60-1487-4eef-aefa-69a04162a385 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:41.682555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88fc3-5d6a-40c4-880f-18be59ae4d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:41.683952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88fc3-5d6a-40c4-880f-18be59ae4d91 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.729609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aae60-1487-4eef-aefa-69a04162a385 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:41.762051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd6196-c8e7-439b-bd14-f5da5974c7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:41.762728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd6196-c8e7-439b-bd14-f5da5974c7c8 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:41.763016 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd6196-c8e7-439b-bd14-f5da5974c7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:41.763304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd6196-c8e7-439b-bd14-f5da5974c7c8 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:41.764001 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd6196-c8e7-439b-bd14-f5da5974c7c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:41.765476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd6196-c8e7-439b-bd14-f5da5974c7c8 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.780256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 258/519] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:41.781108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88fc3-5d6a-40c4-880f-18be59ae4d91 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:41.875177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88fc3-5d6a-40c4-880f-18be59ae4d91 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:41.886045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 262/520] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:17:41 2022] POST /identity/v3/users => generated 247 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:17:41.887003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd6196-c8e7-439b-bd14-f5da5974c7c8 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:41.910022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef72175-de66-42a1-a3f0-bdda36d90c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:41.910717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72175-de66-42a1-a3f0-bdda36d90c6d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:41.910999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72175-de66-42a1-a3f0-bdda36d90c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:41.911274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef72175-de66-42a1-a3f0-bdda36d90c6d None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:41.912020 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef72175-de66-42a1-a3f0-bdda36d90c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:41.912326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef72175-de66-42a1-a3f0-bdda36d90c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:41.914453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef72175-de66-42a1-a3f0-bdda36d90c6d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:41.932061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 259/521] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:41.932061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef72175-de66-42a1-a3f0-bdda36d90c6d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:42.003600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd6196-c8e7-439b-bd14-f5da5974c7c8 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.036915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef72175-de66-42a1-a3f0-bdda36d90c6d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.039656 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da448480-a9e5-4466-a6dc-513144e52470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.040067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da448480-a9e5-4466-a6dc-513144e52470 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.040351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da448480-a9e5-4466-a6dc-513144e52470 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.040627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da448480-a9e5-4466-a6dc-513144e52470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.074717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ba278-7b7a-486d-9682-8784c77851f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.075371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ba278-7b7a-486d-9682-8784c77851f3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.075651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ba278-7b7a-486d-9682-8784c77851f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.075927 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ba278-7b7a-486d-9682-8784c77851f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.076762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ba278-7b7a-486d-9682-8784c77851f3 None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=156646eda779439784ddbc7d1fbd5b90) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:42.077067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ba278-7b7a-486d-9682-8784c77851f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:42.078541 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ba278-7b7a-486d-9682-8784c77851f3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:42.084480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 260/522] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:41 2022] GET /identity/v3/role_assignments?user.id=156646eda779439784ddbc7d1fbd5b90&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:42.086870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ba278-7b7a-486d-9682-8784c77851f3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:42.127346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da448480-a9e5-4466-a6dc-513144e52470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:42.128961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da448480-a9e5-4466-a6dc-513144e52470 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:42.205761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ba278-7b7a-486d-9682-8784c77851f3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.246217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22805204-0c0c-4c2f-a359-1e9deba80b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.247038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22805204-0c0c-4c2f-a359-1e9deba80b65 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.247322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22805204-0c0c-4c2f-a359-1e9deba80b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.247596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22805204-0c0c-4c2f-a359-1e9deba80b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.258705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 263/523] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:42.259649 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da448480-a9e5-4466-a6dc-513144e52470 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:42.261334 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22805204-0c0c-4c2f-a359-1e9deba80b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:42.263068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22805204-0c0c-4c2f-a359-1e9deba80b65 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-22805204-0c0c-4c2f-a359-1e9deba80b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:42.284562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:42.285521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:42.286335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:42.286335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:42.286335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:42.286335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:42.286335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 261/524] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:42.287061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22805204-0c0c-4c2f-a359-1e9deba80b65 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:42.370417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da448480-a9e5-4466-a6dc-513144e52470 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.406462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22805204-0c0c-4c2f-a359-1e9deba80b65 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.407008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78900-0a60-4afd-89fc-3509a93b1e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.407386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78900-0a60-4afd-89fc-3509a93b1e6d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.407794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78900-0a60-4afd-89fc-3509a93b1e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.408080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78900-0a60-4afd-89fc-3509a93b1e6d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.416260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78900-0a60-4afd-89fc-3509a93b1e6d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:42.417778 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78900-0a60-4afd-89fc-3509a93b1e6d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-22f78900-0a60-4afd-89fc-3509a93b1e6d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:42.436666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:42.438918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 264/525] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:42.441873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78900-0a60-4afd-89fc-3509a93b1e6d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:42.456621 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e8412-3b2f-4e40-96f8-db5054dc2dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.457792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e8412-3b2f-4e40-96f8-db5054dc2dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.458077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e8412-3b2f-4e40-96f8-db5054dc2dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.458407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e8412-3b2f-4e40-96f8-db5054dc2dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.470939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e8412-3b2f-4e40-96f8-db5054dc2dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:42.472445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e8412-3b2f-4e40-96f8-db5054dc2dc5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9d0e8412-3b2f-4e40-96f8-db5054dc2dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:42.490431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:42.493315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:42.496185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:42.496185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:42.496185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:42.496185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:42.496185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 262/526] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:42.496185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e8412-3b2f-4e40-96f8-db5054dc2dc5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:42.555740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78900-0a60-4afd-89fc-3509a93b1e6d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.597594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e8412-3b2f-4e40-96f8-db5054dc2dc5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.601193 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3890ba-3668-4b9f-906c-bcc823306b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.602331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3890ba-3668-4b9f-906c-bcc823306b66 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.602799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3890ba-3668-4b9f-906c-bcc823306b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.603237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3890ba-3668-4b9f-906c-bcc823306b66 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.604601 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3890ba-3668-4b9f-906c-bcc823306b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:42.605154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3890ba-3668-4b9f-906c-bcc823306b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:42.608582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3890ba-3668-4b9f-906c-bcc823306b66 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:42.628841 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 265/527] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:42.629798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3890ba-3668-4b9f-906c-bcc823306b66 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:42.634777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e70ae-06fb-47b8-8230-5d84612c63f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.635532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e70ae-06fb-47b8-8230-5d84612c63f4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.635815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e70ae-06fb-47b8-8230-5d84612c63f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.636089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e70ae-06fb-47b8-8230-5d84612c63f4 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.637003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e70ae-06fb-47b8-8230-5d84612c63f4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:42.637379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e70ae-06fb-47b8-8230-5d84612c63f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:42.638957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e70ae-06fb-47b8-8230-5d84612c63f4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:42.658700 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 263/528] 10.222.0.59 () {56 vars in 1139 bytes} [Thu May 12 20:17:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:42.659631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e70ae-06fb-47b8-8230-5d84612c63f4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:42.735726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3890ba-3668-4b9f-906c-bcc823306b66 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.766027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e70ae-06fb-47b8-8230-5d84612c63f4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.772972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529db339-0fc7-4f75-b15d-7bb1c66b40aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.773689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529db339-0fc7-4f75-b15d-7bb1c66b40aa None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.774070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529db339-0fc7-4f75-b15d-7bb1c66b40aa None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.774366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529db339-0fc7-4f75-b15d-7bb1c66b40aa None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.775109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529db339-0fc7-4f75-b15d-7bb1c66b40aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:42.775418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529db339-0fc7-4f75-b15d-7bb1c66b40aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:42.776827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529db339-0fc7-4f75-b15d-7bb1c66b40aa None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:42.789215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 266/529] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:42.790204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529db339-0fc7-4f75-b15d-7bb1c66b40aa None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:42.802898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac298534-6a3a-4b86-972b-d27f186b02e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.803750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298534-6a3a-4b86-972b-d27f186b02e2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.804579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298534-6a3a-4b86-972b-d27f186b02e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.804848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298534-6a3a-4b86-972b-d27f186b02e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.812212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac298534-6a3a-4b86-972b-d27f186b02e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:42.813702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac298534-6a3a-4b86-972b-d27f186b02e2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ac298534-6a3a-4b86-972b-d27f186b02e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:42.829311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:42.831535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:42.832862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:42.832862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:42.832862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:42.832862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:42.832862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:42.832862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:42.832862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:42.832862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:42.832862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 264/530] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:42.832862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac298534-6a3a-4b86-972b-d27f186b02e2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:42.897372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529db339-0fc7-4f75-b15d-7bb1c66b40aa None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.942154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213bafa-7afe-49dc-80a0-e1348a5d80b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.942827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213bafa-7afe-49dc-80a0-e1348a5d80b6 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.943114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213bafa-7afe-49dc-80a0-e1348a5d80b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.943391 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213bafa-7afe-49dc-80a0-e1348a5d80b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.945781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac298534-6a3a-4b86-972b-d27f186b02e2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:42.980297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68d00b-dd60-4466-9d09-c746d893c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:42.981611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d00b-dd60-4466-9d09-c746d893c8ef None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:42.982110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d00b-dd60-4466-9d09-c746d893c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:42.982590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d00b-dd60-4466-9d09-c746d893c8ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:42.990104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68d00b-dd60-4466-9d09-c746d893c8ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:42.992453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68d00b-dd60-4466-9d09-c746d893c8ef None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9c68d00b-dd60-4466-9d09-c746d893c8ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:43.008764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:43.009950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:43.010885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:43.010885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:43.010885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:43.010885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:43.010885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:43.010885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:43.010885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:43.010885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:43.013292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 265/531] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:43.014533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68d00b-dd60-4466-9d09-c746d893c8ef None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:43.015147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213bafa-7afe-49dc-80a0-e1348a5d80b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:43.016561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213bafa-7afe-49dc-80a0-e1348a5d80b6 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:43.120380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 267/532] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:43.121516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213bafa-7afe-49dc-80a0-e1348a5d80b6 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:43.123750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68d00b-dd60-4466-9d09-c746d893c8ef None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:43.160254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d324f-7980-4ed2-997f-f33aa200d30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:43.161318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d324f-7980-4ed2-997f-f33aa200d30a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:43.161803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d324f-7980-4ed2-997f-f33aa200d30a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:43.162295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d324f-7980-4ed2-997f-f33aa200d30a None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:43.163855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d324f-7980-4ed2-997f-f33aa200d30a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:43.164870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d324f-7980-4ed2-997f-f33aa200d30a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:43.166530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d324f-7980-4ed2-997f-f33aa200d30a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:43.186786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 266/533] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:43.188014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d324f-7980-4ed2-997f-f33aa200d30a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:43.230042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213bafa-7afe-49dc-80a0-e1348a5d80b6 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:43.267821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd3494-0c22-42aa-8ea6-ab1e6a04a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:43.268505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd3494-0c22-42aa-8ea6-ab1e6a04a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:43.268792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd3494-0c22-42aa-8ea6-ab1e6a04a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:43.269076 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd3494-0c22-42aa-8ea6-ab1e6a04a3c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:43.269918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd3494-0c22-42aa-8ea6-ab1e6a04a3c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:43.270235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd3494-0c22-42aa-8ea6-ab1e6a04a3c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:43.271696 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd3494-0c22-42aa-8ea6-ab1e6a04a3c2 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:43.284658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 268/534] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:43.285618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd3494-0c22-42aa-8ea6-ab1e6a04a3c2 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:43.301438 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d324f-7980-4ed2-997f-f33aa200d30a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:43.339196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af99e5-9b0d-413c-93c1-5f319532b4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:43.340444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af99e5-9b0d-413c-93c1-5f319532b4da None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:43.341091 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af99e5-9b0d-413c-93c1-5f319532b4da None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:43.341612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af99e5-9b0d-413c-93c1-5f319532b4da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:43.355097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af99e5-9b0d-413c-93c1-5f319532b4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:43.356907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af99e5-9b0d-413c-93c1-5f319532b4da None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-67af99e5-9b0d-413c-93c1-5f319532b4da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:43.377054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:43.378097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:43.378910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:43.378910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:43.378910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:43.378910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:43.381173 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 267/535] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:43.382736 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af99e5-9b0d-413c-93c1-5f319532b4da None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:43.392435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd3494-0c22-42aa-8ea6-ab1e6a04a3c2 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:43.427022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeae8da-5e2e-4569-afa6-84e4db8b7e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:43.427690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae8da-5e2e-4569-afa6-84e4db8b7e0e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:43.427962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae8da-5e2e-4569-afa6-84e4db8b7e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:43.428242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae8da-5e2e-4569-afa6-84e4db8b7e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:43.429760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeae8da-5e2e-4569-afa6-84e4db8b7e0e None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=a32db19a943345b6ba1c91e79739835f) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:43.430382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeae8da-5e2e-4569-afa6-84e4db8b7e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:43.431435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeae8da-5e2e-4569-afa6-84e4db8b7e0e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:43.445378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 269/536] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:43 2022] GET /identity/v3/role_assignments?user.id=a32db19a943345b6ba1c91e79739835f&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:43.446028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeae8da-5e2e-4569-afa6-84e4db8b7e0e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:43.496843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af99e5-9b0d-413c-93c1-5f319532b4da None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:43.535782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef141-e94e-40e5-aed3-15b0e62e088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:43.536811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef141-e94e-40e5-aed3-15b0e62e088a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:43.537308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef141-e94e-40e5-aed3-15b0e62e088a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:43.537779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef141-e94e-40e5-aed3-15b0e62e088a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:43.540120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fef141-e94e-40e5-aed3-15b0e62e088a None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=1f8ec4765e05461a98b3c9eb1d3ced5d) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:43.540661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fef141-e94e-40e5-aed3-15b0e62e088a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:43.542321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fef141-e94e-40e5-aed3-15b0e62e088a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:43.548489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 268/537] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:43 2022] GET /identity/v3/role_assignments?user.id=1f8ec4765e05461a98b3c9eb1d3ced5d&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:43.563409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeae8da-5e2e-4569-afa6-84e4db8b7e0e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:43.617384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb3ea8-bae9-4b24-9bc2-e8d6c3f152ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:43.618127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb3ea8-bae9-4b24-9bc2-e8d6c3f152ea None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:43.618412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb3ea8-bae9-4b24-9bc2-e8d6c3f152ea None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:43.618688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb3ea8-bae9-4b24-9bc2-e8d6c3f152ea None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:43.619766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb3ea8-bae9-4b24-9bc2-e8d6c3f152ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:43.620081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb3ea8-bae9-4b24-9bc2-e8d6c3f152ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:43.621540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb3ea8-bae9-4b24-9bc2-e8d6c3f152ea None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:43.639892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 270/538] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:43.646443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef141-e94e-40e5-aed3-15b0e62e088a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:43.780633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef141-e94e-40e5-aed3-15b0e62e088a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:43.822488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dbf18-19bb-4f78-8051-5925204a4b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:43.822488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dbf18-19bb-4f78-8051-5925204a4b38 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:43.822488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dbf18-19bb-4f78-8051-5925204a4b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:43.822488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dbf18-19bb-4f78-8051-5925204a4b38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:43.829931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0dbf18-19bb-4f78-8051-5925204a4b38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:43.831380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0dbf18-19bb-4f78-8051-5925204a4b38 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9c0dbf18-19bb-4f78-8051-5925204a4b38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:43.846183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:43.847068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:43.847893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:43.847893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:43.847893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:43.847893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:43.847893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:43.847893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:43.847893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:43.847893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:43.847893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 269/539] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:43.853860 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb3ea8-bae9-4b24-9bc2-e8d6c3f152ea None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:43.984351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb3ea8-bae9-4b24-9bc2-e8d6c3f152ea None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:44.021063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c0711-a648-4697-b87b-6434a95973cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:44.021817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c0711-a648-4697-b87b-6434a95973cd None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:44.022100 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c0711-a648-4697-b87b-6434a95973cd None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:44.022419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c0711-a648-4697-b87b-6434a95973cd None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:44.023271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c0711-a648-4697-b87b-6434a95973cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:44.023578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c0711-a648-4697-b87b-6434a95973cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:44.025019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c0711-a648-4697-b87b-6434a95973cd None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:44.042247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 271/540] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:44.049207 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dbf18-19bb-4f78-8051-5925204a4b38 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:44.208756 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dbf18-19bb-4f78-8051-5925204a4b38 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:44.256918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831517ec-64e4-4ada-803a-024fc2532e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:44.257679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831517ec-64e4-4ada-803a-024fc2532e3c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:44.257971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831517ec-64e4-4ada-803a-024fc2532e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:44.258251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831517ec-64e4-4ada-803a-024fc2532e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:44.259103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831517ec-64e4-4ada-803a-024fc2532e3c None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=4379d3e8b38645978efb08ea6f560fc0) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:44.259415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831517ec-64e4-4ada-803a-024fc2532e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:44.260847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831517ec-64e4-4ada-803a-024fc2532e3c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:44.267357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 270/541] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:44 2022] GET /identity/v3/role_assignments?user.id=4379d3e8b38645978efb08ea6f560fc0&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:44.550086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1179c0-e054-4969-953d-d3ab8d473762 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:44.550773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1179c0-e054-4969-953d-d3ab8d473762 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:44.550773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1179c0-e054-4969-953d-d3ab8d473762 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:44.552366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 272/542] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:44.558957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33066dac-fb11-49ed-8726-87dc00c32d6a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:44.559603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33066dac-fb11-49ed-8726-87dc00c32d6a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:44.559603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33066dac-fb11-49ed-8726-87dc00c32d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:44.582513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-33066dac-fb11-49ed-8726-87dc00c32d6a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:44.583771 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-33066dac-fb11-49ed-8726-87dc00c32d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:44.624785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dbfb0-2aa6-4efd-855a-c04e36d941a1 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:44.625088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dbfb0-2aa6-4efd-855a-c04e36d941a1 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:44.625379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dbfb0-2aa6-4efd-855a-c04e36d941a1 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:44.626988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 273/543] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:44.641154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22407d6-8374-40e5-84f7-4ddeb9e424ed None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:44.641471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22407d6-8374-40e5-84f7-4ddeb9e424ed None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:44.641734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22407d6-8374-40e5-84f7-4ddeb9e424ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:44.669409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 271/544] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:44.675883 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f22407d6-8374-40e5-84f7-4ddeb9e424ed None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:44.677249 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f22407d6-8374-40e5-84f7-4ddeb9e424ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:44.692679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33066dac-fb11-49ed-8726-87dc00c32d6a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:44.809939 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 274/545] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:44.864640 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33066dac-fb11-49ed-8726-87dc00c32d6a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:44.879523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22407d6-8374-40e5-84f7-4ddeb9e424ed None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:44.939330 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563a424-1533-4c8a-88a2-4a4959d917bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:44.940147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563a424-1533-4c8a-88a2-4a4959d917bf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:44.940431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563a424-1533-4c8a-88a2-4a4959d917bf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:44.940713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563a424-1533-4c8a-88a2-4a4959d917bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:44.962358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563a424-1533-4c8a-88a2-4a4959d917bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f563a424-1533-4c8a-88a2-4a4959d917bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:44.980171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:44.981154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:44.982328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:44.989186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 272/546] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:44.990574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563a424-1533-4c8a-88a2-4a4959d917bf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:45.088677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22407d6-8374-40e5-84f7-4ddeb9e424ed None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:45.131065 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caef9d-264b-4319-8e09-2be1110384df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:45.132282 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caef9d-264b-4319-8e09-2be1110384df None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:45.132780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caef9d-264b-4319-8e09-2be1110384df None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:45.133264 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caef9d-264b-4319-8e09-2be1110384df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:45.144509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0caef9d-264b-4319-8e09-2be1110384df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-c0caef9d-264b-4319-8e09-2be1110384df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:45.154146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:45.155082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:45.155864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:45.159005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 275/547] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:45.168700 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563a424-1533-4c8a-88a2-4a4959d917bf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:45.173768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caef9d-264b-4319-8e09-2be1110384df None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:45.230755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e517b4-eec4-443c-9d7b-7986c469f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:45.232075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e517b4-eec4-443c-9d7b-7986c469f541 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:45.232362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e517b4-eec4-443c-9d7b-7986c469f541 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:45.232643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e517b4-eec4-443c-9d7b-7986c469f541 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:45.234173 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e517b4-eec4-443c-9d7b-7986c469f541 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:45.234486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e517b4-eec4-443c-9d7b-7986c469f541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:45.236577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e517b4-eec4-443c-9d7b-7986c469f541 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:45.259663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 273/548] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:45.267460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e517b4-eec4-443c-9d7b-7986c469f541 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:45.387640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caef9d-264b-4319-8e09-2be1110384df None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:45.411975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e517b4-eec4-443c-9d7b-7986c469f541 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:45.452689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a9f20-d34b-4fee-a1ef-3d6ba0bed889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:45.454538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9f20-d34b-4fee-a1ef-3d6ba0bed889 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:45.455528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9f20-d34b-4fee-a1ef-3d6ba0bed889 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:45.456487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a9f20-d34b-4fee-a1ef-3d6ba0bed889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:45.473968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a9f20-d34b-4fee-a1ef-3d6ba0bed889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:45.475024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8816-61e7-4205-a0e6-6f1882ecb843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:45.476287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8816-61e7-4205-a0e6-6f1882ecb843 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:45.476569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8816-61e7-4205-a0e6-6f1882ecb843 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:45.476839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8816-61e7-4205-a0e6-6f1882ecb843 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:45.477340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a9f20-d34b-4fee-a1ef-3d6ba0bed889 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:45.477681 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff8816-61e7-4205-a0e6-6f1882ecb843 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:45.477990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff8816-61e7-4205-a0e6-6f1882ecb843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:45.479345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff8816-61e7-4205-a0e6-6f1882ecb843 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-568a9f20-d34b-4fee-a1ef-3d6ba0bed889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:45.501724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:45.502639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:45.503508 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:45.503508 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:45.503508 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:45.503508 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:45.504375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 276/549] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:45.506419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 274/550] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:45.514491 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8816-61e7-4205-a0e6-6f1882ecb843 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:45.516260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a9f20-d34b-4fee-a1ef-3d6ba0bed889 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:45.733305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8816-61e7-4205-a0e6-6f1882ecb843 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:45.736046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a9f20-d34b-4fee-a1ef-3d6ba0bed889 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:45.787945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4247d9f-819e-4021-a0d6-f4449e111077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:45.789000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247d9f-819e-4021-a0d6-f4449e111077 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:45.789429 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247d9f-819e-4021-a0d6-f4449e111077 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:45.789813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247d9f-819e-4021-a0d6-f4449e111077 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:45.790678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4247d9f-819e-4021-a0d6-f4449e111077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:45.791673 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4247d9f-819e-4021-a0d6-f4449e111077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:45.793374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4247d9f-819e-4021-a0d6-f4449e111077 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:45.809194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 277/551] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:45.816549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4247d9f-819e-4021-a0d6-f4449e111077 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:45.837500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ff01-3c63-4538-9cf3-cfce7249cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:45.838335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ff01-3c63-4538-9cf3-cfce7249cc9d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:45.838602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ff01-3c63-4538-9cf3-cfce7249cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:45.838882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ff01-3c63-4538-9cf3-cfce7249cc9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:45.874467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ff01-3c63-4538-9cf3-cfce7249cc9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:45.876880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ff01-3c63-4538-9cf3-cfce7249cc9d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-6924ff01-3c63-4538-9cf3-cfce7249cc9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:45.924375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:45.926687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:45.930847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:45.930847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:45.930847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:45.930847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:45.930847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 275/552] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:45.942976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ff01-3c63-4538-9cf3-cfce7249cc9d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:46.004557 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4247d9f-819e-4021-a0d6-f4449e111077 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:46.049657 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b5e7-07e9-4b5b-8eff-3539264a2afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:46.050934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b5e7-07e9-4b5b-8eff-3539264a2afe None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:46.051437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b5e7-07e9-4b5b-8eff-3539264a2afe None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:46.051963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b5e7-07e9-4b5b-8eff-3539264a2afe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:46.065395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94b5e7-07e9-4b5b-8eff-3539264a2afe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:46.067259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94b5e7-07e9-4b5b-8eff-3539264a2afe None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-6b94b5e7-07e9-4b5b-8eff-3539264a2afe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:46.097032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:46.098052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:46.098913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:46.098913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:46.098913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:46.098913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:46.098913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:46.098913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:46.098913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:46.098913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:46.098913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 20:17:46.098913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:46.109819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 278/553] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:17:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:46.115790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b5e7-07e9-4b5b-8eff-3539264a2afe None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:46.161495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ff01-3c63-4538-9cf3-cfce7249cc9d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:46.225455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65f2aa-e2da-4316-a684-5f04db88fd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:46.227195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65f2aa-e2da-4316-a684-5f04db88fd4f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:46.227717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65f2aa-e2da-4316-a684-5f04db88fd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:46.228249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65f2aa-e2da-4316-a684-5f04db88fd4f None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:46.229550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65f2aa-e2da-4316-a684-5f04db88fd4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:46.230051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65f2aa-e2da-4316-a684-5f04db88fd4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:46.232554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65f2aa-e2da-4316-a684-5f04db88fd4f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:46.254758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 276/554] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:46.262965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65f2aa-e2da-4316-a684-5f04db88fd4f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:46.311126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b5e7-07e9-4b5b-8eff-3539264a2afe None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:46.356490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb4145-87ca-48d8-8bc9-9317f76bada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:46.357208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4145-87ca-48d8-8bc9-9317f76bada9 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:46.357493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4145-87ca-48d8-8bc9-9317f76bada9 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:46.357776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb4145-87ca-48d8-8bc9-9317f76bada9 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:46.358637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb4145-87ca-48d8-8bc9-9317f76bada9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:46.358951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb4145-87ca-48d8-8bc9-9317f76bada9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:46.360407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb4145-87ca-48d8-8bc9-9317f76bada9 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:46.389288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 279/555] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 12 20:17:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:46.396270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb4145-87ca-48d8-8bc9-9317f76bada9 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:46.493743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65f2aa-e2da-4316-a684-5f04db88fd4f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:46.561436 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73463-ec04-453a-867f-7e044cd39fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:46.562566 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73463-ec04-453a-867f-7e044cd39fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:46.563052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73463-ec04-453a-867f-7e044cd39fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:46.563476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73463-ec04-453a-867f-7e044cd39fe5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:46.574960 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73463-ec04-453a-867f-7e044cd39fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:46.576874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73463-ec04-453a-867f-7e044cd39fe5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c5c73463-ec04-453a-867f-7e044cd39fe5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:46.599716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:46.602073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 277/556] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 12 20:17:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557e977-b0c6-44db-9e72-91b5f2d285a3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:46.609204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557e977-b0c6-44db-9e72-91b5f2d285a3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:46.612057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557e977-b0c6-44db-9e72-91b5f2d285a3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:46.612057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 278/557] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:46.613772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb4145-87ca-48d8-8bc9-9317f76bada9 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:46.614494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76fd8-efbc-470b-917f-c597517983a7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:46.615494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76fd8-efbc-470b-917f-c597517983a7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:46.617320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76fd8-efbc-470b-917f-c597517983a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:46.647008 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-77a76fd8-efbc-470b-917f-c597517983a7 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:46.649310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-77a76fd8-efbc-470b-917f-c597517983a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:46.658150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccb9fd-0c35-4ae5-9f6a-bc384a962971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:46.658861 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccb9fd-0c35-4ae5-9f6a-bc384a962971 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:46.659155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccb9fd-0c35-4ae5-9f6a-bc384a962971 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:46.659442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccb9fd-0c35-4ae5-9f6a-bc384a962971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:46.737882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccb9fd-0c35-4ae5-9f6a-bc384a962971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:46.739467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccb9fd-0c35-4ae5-9f6a-bc384a962971 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:46.747602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 279/558] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:46.749404 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a76fd8-efbc-470b-917f-c597517983a7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:46.876574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a76fd8-efbc-470b-917f-c597517983a7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:46.880293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 280/559] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:46.881115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90e47-1e10-40c8-8058-e9e514b9d594 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:46.881442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90e47-1e10-40c8-8058-e9e514b9d594 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:46.882237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90e47-1e10-40c8-8058-e9e514b9d594 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:46.887607 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 281/560] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:46.887607 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d90e47-1e10-40c8-8058-e9e514b9d594 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:46.921700 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5fbc7-a119-4458-b8b5-30d5e2fd5b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:46.922412 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5fbc7-a119-4458-b8b5-30d5e2fd5b84 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:46.922715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5fbc7-a119-4458-b8b5-30d5e2fd5b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:46.922989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5fbc7-a119-4458-b8b5-30d5e2fd5b84 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:46.923880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5fbc7-a119-4458-b8b5-30d5e2fd5b84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:46.924188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5fbc7-a119-4458-b8b5-30d5e2fd5b84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:46.925901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5fbc7-a119-4458-b8b5-30d5e2fd5b84 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:46.948491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 280/561] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 12 20:17:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:46.950219 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2ac59-20fc-44cf-8667-82d3c3b2897b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:46.950680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2ac59-20fc-44cf-8667-82d3c3b2897b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:46.951205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2ac59-20fc-44cf-8667-82d3c3b2897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:46.971089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8df2ac59-20fc-44cf-8667-82d3c3b2897b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:46.972317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8df2ac59-20fc-44cf-8667-82d3c3b2897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:47.017776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d90e47-1e10-40c8-8058-e9e514b9d594 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:47.054028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 281/562] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:47.055793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2ac59-20fc-44cf-8667-82d3c3b2897b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:47.069117 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0817ed-c954-4e58-8543-c0edb1bb5af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:47.071492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0817ed-c954-4e58-8543-c0edb1bb5af7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.072029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0817ed-c954-4e58-8543-c0edb1bb5af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.072319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0817ed-c954-4e58-8543-c0edb1bb5af7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.090412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0817ed-c954-4e58-8543-c0edb1bb5af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-7a0817ed-c954-4e58-8543-c0edb1bb5af7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:47.098877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:47.100328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:47.101260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:47.102772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 282/563] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:47.103620 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0817ed-c954-4e58-8543-c0edb1bb5af7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:47.173524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2ac59-20fc-44cf-8667-82d3c3b2897b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:47.209523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899456-af4a-4d24-8213-bd36f58914bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:47.210610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899456-af4a-4d24-8213-bd36f58914bb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.211002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899456-af4a-4d24-8213-bd36f58914bb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.211290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd899456-af4a-4d24-8213-bd36f58914bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.222131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd899456-af4a-4d24-8213-bd36f58914bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:47.223383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0817ed-c954-4e58-8543-c0edb1bb5af7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:47.223656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd899456-af4a-4d24-8213-bd36f58914bb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-bd899456-af4a-4d24-8213-bd36f58914bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:47.243042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:47.244435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:47.245340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:47.245340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:47.245340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:47.245340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:47.245340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 282/564] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:47.245340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899456-af4a-4d24-8213-bd36f58914bb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:47.260323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15044c1c-34f0-492c-b8dd-b58060c69160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:47.261122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15044c1c-34f0-492c-b8dd-b58060c69160 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.261436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15044c1c-34f0-492c-b8dd-b58060c69160 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.261713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15044c1c-34f0-492c-b8dd-b58060c69160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.273618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15044c1c-34f0-492c-b8dd-b58060c69160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:47.275092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15044c1c-34f0-492c-b8dd-b58060c69160 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-15044c1c-34f0-492c-b8dd-b58060c69160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:47.293762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:47.294732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:47.295595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:47.295595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:47.295595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:47.295595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:47.295595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 283/565] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:47.296152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15044c1c-34f0-492c-b8dd-b58060c69160 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:47.356383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd899456-af4a-4d24-8213-bd36f58914bb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:47.393015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd140a0d-b0b3-4f56-9e27-0f73edf0d0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:47.393848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd140a0d-b0b3-4f56-9e27-0f73edf0d0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.394131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd140a0d-b0b3-4f56-9e27-0f73edf0d0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.394414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd140a0d-b0b3-4f56-9e27-0f73edf0d0c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.404844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd140a0d-b0b3-4f56-9e27-0f73edf0d0c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-bd140a0d-b0b3-4f56-9e27-0f73edf0d0c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:47.412172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:47.414594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 283/566] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:47.415428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1a5f-4d10-4e6c-84dd-4d3be112d562 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.416161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1a5f-4d10-4e6c-84dd-4d3be112d562 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.416161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1a5f-4d10-4e6c-84dd-4d3be112d562 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.417294 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 284/567] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:47.418022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c1a5f-4d10-4e6c-84dd-4d3be112d562 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:47.426043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15044c1c-34f0-492c-b8dd-b58060c69160 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:47.459553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a26e2-349a-4d2e-abe9-9b0df60dd412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:47.460357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a26e2-349a-4d2e-abe9-9b0df60dd412 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.460857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a26e2-349a-4d2e-abe9-9b0df60dd412 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.461307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a26e2-349a-4d2e-abe9-9b0df60dd412 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.462132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a26e2-349a-4d2e-abe9-9b0df60dd412 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:47.462470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a26e2-349a-4d2e-abe9-9b0df60dd412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:47.463840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a26e2-349a-4d2e-abe9-9b0df60dd412 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:47.472282 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 284/568] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:47.473085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a26e2-349a-4d2e-abe9-9b0df60dd412 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:47.523760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c1a5f-4d10-4e6c-84dd-4d3be112d562 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:47.557066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000c53-096e-4a6f-b537-784bcf92b579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:47.557756 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000c53-096e-4a6f-b537-784bcf92b579 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.559004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000c53-096e-4a6f-b537-784bcf92b579 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.559004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000c53-096e-4a6f-b537-784bcf92b579 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.559216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8000c53-096e-4a6f-b537-784bcf92b579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:47.559439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8000c53-096e-4a6f-b537-784bcf92b579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:47.560992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8000c53-096e-4a6f-b537-784bcf92b579 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:47.579044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 285/569] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:47.580402 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfb663-037f-4507-9ef8-d691ee529d90 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.580692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfb663-037f-4507-9ef8-d691ee529d90 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.580971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfb663-037f-4507-9ef8-d691ee529d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.583031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a26e2-349a-4d2e-abe9-9b0df60dd412 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:47.598324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-15bfb663-037f-4507-9ef8-d691ee529d90 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:47.599511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-15bfb663-037f-4507-9ef8-d691ee529d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:47.616970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f333-ff41-4c09-b2eb-f0ada3a7980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:47.617690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f333-ff41-4c09-b2eb-f0ada3a7980b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.617979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f333-ff41-4c09-b2eb-f0ada3a7980b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.618257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f333-ff41-4c09-b2eb-f0ada3a7980b None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.619248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6f333-ff41-4c09-b2eb-f0ada3a7980b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:47.619773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6f333-ff41-4c09-b2eb-f0ada3a7980b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:47.621293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6f333-ff41-4c09-b2eb-f0ada3a7980b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:47.637578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 285/570] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:47.638442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f333-ff41-4c09-b2eb-f0ada3a7980b None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:47.684777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 286/571] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:47.686184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfb663-037f-4507-9ef8-d691ee529d90 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:47.802246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f333-ff41-4c09-b2eb-f0ada3a7980b None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:47.819472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfb663-037f-4507-9ef8-d691ee529d90 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:47.836188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fd1f-a362-4548-a13d-408d54441e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:47.836868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fd1f-a362-4548-a13d-408d54441e06 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.837157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fd1f-a362-4548-a13d-408d54441e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.837468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9fd1f-a362-4548-a13d-408d54441e06 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.838229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9fd1f-a362-4548-a13d-408d54441e06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:47.838540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9fd1f-a362-4548-a13d-408d54441e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:47.839925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9fd1f-a362-4548-a13d-408d54441e06 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:47.848082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 286/572] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:47.848884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fd1f-a362-4548-a13d-408d54441e06 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:47.856849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd14d5-1bbd-4bff-8411-0067615b66dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:47.857728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd14d5-1bbd-4bff-8411-0067615b66dd None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:47.858073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd14d5-1bbd-4bff-8411-0067615b66dd None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:47.858348 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd14d5-1bbd-4bff-8411-0067615b66dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:47.870004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd14d5-1bbd-4bff-8411-0067615b66dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:47.871507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd14d5-1bbd-4bff-8411-0067615b66dd None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-bfdd14d5-1bbd-4bff-8411-0067615b66dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:47.888916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:47.890423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:47.891288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:47.891288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:47.891288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:47.891288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:47.891288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 287/573] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:47.891288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd14d5-1bbd-4bff-8411-0067615b66dd None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:47.961092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9fd1f-a362-4548-a13d-408d54441e06 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.010410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd14d5-1bbd-4bff-8411-0067615b66dd None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.012145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad265ae-bab7-4d74-83d6-8c44ddebb442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.013415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad265ae-bab7-4d74-83d6-8c44ddebb442 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.013878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad265ae-bab7-4d74-83d6-8c44ddebb442 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.014320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad265ae-bab7-4d74-83d6-8c44ddebb442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.025654 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad265ae-bab7-4d74-83d6-8c44ddebb442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.028598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad265ae-bab7-4d74-83d6-8c44ddebb442 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-6ad265ae-bab7-4d74-83d6-8c44ddebb442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:48.045749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:48.046882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:48.048680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:48.048680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:48.048680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:48.048680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:48.048680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:48.048680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:48.048680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:48.048680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:48.048680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 287/574] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:48.048680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad265ae-bab7-4d74-83d6-8c44ddebb442 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.063929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52447e69-4228-406a-aa4f-bf8416effdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.064724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52447e69-4228-406a-aa4f-bf8416effdfa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.065004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52447e69-4228-406a-aa4f-bf8416effdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.065290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52447e69-4228-406a-aa4f-bf8416effdfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.072360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52447e69-4228-406a-aa4f-bf8416effdfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.073845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52447e69-4228-406a-aa4f-bf8416effdfa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-52447e69-4228-406a-aa4f-bf8416effdfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:48.088537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:48.089620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:48.090511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:48.090511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:48.090511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:48.090511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:48.090511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:48.090511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:48.090511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:48.090511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:48.090511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 288/575] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:48.090982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52447e69-4228-406a-aa4f-bf8416effdfa None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.171594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad265ae-bab7-4d74-83d6-8c44ddebb442 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.186028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52447e69-4228-406a-aa4f-bf8416effdfa None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.203252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e3969-4c36-4983-b7ff-bcbd0a73285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.204045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e3969-4c36-4983-b7ff-bcbd0a73285c None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.204329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e3969-4c36-4983-b7ff-bcbd0a73285c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.204604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e3969-4c36-4983-b7ff-bcbd0a73285c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.215077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e3969-4c36-4983-b7ff-bcbd0a73285c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:48.219544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8f755-ea5d-4994-b96c-a3a503eed841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.220333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8f755-ea5d-4994-b96c-a3a503eed841 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.220627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8f755-ea5d-4994-b96c-a3a503eed841 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.220908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8f755-ea5d-4994-b96c-a3a503eed841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-3f7e3969-4c36-4983-b7ff-bcbd0a73285c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:48.222587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:48.224489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 288/576] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:48.227369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e3969-4c36-4983-b7ff-bcbd0a73285c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.232262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8f755-ea5d-4994-b96c-a3a503eed841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.233751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8f755-ea5d-4994-b96c-a3a503eed841 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b3b8f755-ea5d-4994-b96c-a3a503eed841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:48.251159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:48.252177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:48.253235 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:48.253235 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:48.253235 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:48.253235 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:48.253235 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 289/577] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:48.253693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8f755-ea5d-4994-b96c-a3a503eed841 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.327349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e3969-4c36-4983-b7ff-bcbd0a73285c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.352007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8f755-ea5d-4994-b96c-a3a503eed841 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.359459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d82f9-8d79-41a9-ae94-671095b65e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.360126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d82f9-8d79-41a9-ae94-671095b65e63 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.360417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d82f9-8d79-41a9-ae94-671095b65e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.360707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d82f9-8d79-41a9-ae94-671095b65e63 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.361466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d82f9-8d79-41a9-ae94-671095b65e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:48.361779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d82f9-8d79-41a9-ae94-671095b65e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.363166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d82f9-8d79-41a9-ae94-671095b65e63 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.375225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 289/578] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:48.375867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d82f9-8d79-41a9-ae94-671095b65e63 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.384686 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e906a-4768-40fe-ac88-272218966580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.385372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e906a-4768-40fe-ac88-272218966580 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.385657 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e906a-4768-40fe-ac88-272218966580 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.385931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e906a-4768-40fe-ac88-272218966580 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.386719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e906a-4768-40fe-ac88-272218966580 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:48.387026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e906a-4768-40fe-ac88-272218966580 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.388440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e906a-4768-40fe-ac88-272218966580 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.405602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 290/579] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:48.406709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e906a-4768-40fe-ac88-272218966580 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.494560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d82f9-8d79-41a9-ae94-671095b65e63 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.505285 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e906a-4768-40fe-ac88-272218966580 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.528553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26854e-3f8c-44b4-a96a-067495dbadd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.529227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26854e-3f8c-44b4-a96a-067495dbadd4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.529545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26854e-3f8c-44b4-a96a-067495dbadd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.529830 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26854e-3f8c-44b4-a96a-067495dbadd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.530621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26854e-3f8c-44b4-a96a-067495dbadd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:48.530935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26854e-3f8c-44b4-a96a-067495dbadd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.532378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26854e-3f8c-44b4-a96a-067495dbadd4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.539602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b61a6c-f23a-46d1-8cae-ffdcc9099115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.540272 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b61a6c-f23a-46d1-8cae-ffdcc9099115 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.540557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b61a6c-f23a-46d1-8cae-ffdcc9099115 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.540837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b61a6c-f23a-46d1-8cae-ffdcc9099115 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.541678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b61a6c-f23a-46d1-8cae-ffdcc9099115 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:48.541983 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b61a6c-f23a-46d1-8cae-ffdcc9099115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.545087 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b61a6c-f23a-46d1-8cae-ffdcc9099115 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.545303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 290/580] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:48.545303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26854e-3f8c-44b4-a96a-067495dbadd4 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.552082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 291/581] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:48.552720 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b61a6c-f23a-46d1-8cae-ffdcc9099115 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.649979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26854e-3f8c-44b4-a96a-067495dbadd4 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.652381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b61a6c-f23a-46d1-8cae-ffdcc9099115 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.682373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dadeef-3902-460a-98c4-8abfd9e78158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.683038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dadeef-3902-460a-98c4-8abfd9e78158 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.683327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dadeef-3902-460a-98c4-8abfd9e78158 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.683607 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dadeef-3902-460a-98c4-8abfd9e78158 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.684334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dadeef-3902-460a-98c4-8abfd9e78158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:48.684642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dadeef-3902-460a-98c4-8abfd9e78158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.685180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a593-1cb1-48fb-9097-38e392aacef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.685999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a593-1cb1-48fb-9097-38e392aacef7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.686113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dadeef-3902-460a-98c4-8abfd9e78158 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.686280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a593-1cb1-48fb-9097-38e392aacef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.686557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753a593-1cb1-48fb-9097-38e392aacef7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.694038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a593-1cb1-48fb-9097-38e392aacef7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.696427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753a593-1cb1-48fb-9097-38e392aacef7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.703169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 291/582] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:48.703169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dadeef-3902-460a-98c4-8abfd9e78158 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f753a593-1cb1-48fb-9097-38e392aacef7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:48.711224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:48.712346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 292/583] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:48.713313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a593-1cb1-48fb-9097-38e392aacef7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.798039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dadeef-3902-460a-98c4-8abfd9e78158 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.808636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753a593-1cb1-48fb-9097-38e392aacef7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.839627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858d24-57cc-415f-ad21-5d9abb7c52ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.840498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858d24-57cc-415f-ad21-5d9abb7c52ac None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.840904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858d24-57cc-415f-ad21-5d9abb7c52ac None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.841325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858d24-57cc-415f-ad21-5d9abb7c52ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.842377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aa325-9e8c-47b8-8d07-1a3881950de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:48.842786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9858d24-57cc-415f-ad21-5d9abb7c52ac None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=766497e7e0614adea5769b05f0c1cdcf) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:48.843046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9858d24-57cc-415f-ad21-5d9abb7c52ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.843268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aa325-9e8c-47b8-8d07-1a3881950de0 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:48.843554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aa325-9e8c-47b8-8d07-1a3881950de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:48.843835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68aa325-9e8c-47b8-8d07-1a3881950de0 None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/156646eda779439784ddbc7d1fbd5b90/roles/5c0bc4258a8348c7afa8b9b712d5cd0b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:48.845332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9858d24-57cc-415f-ad21-5d9abb7c52ac None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.853895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 292/584] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/role_assignments?user.id=766497e7e0614adea5769b05f0c1cdcf&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:48.854913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858d24-57cc-415f-ad21-5d9abb7c52ac None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:48.861600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aa325-9e8c-47b8-8d07-1a3881950de0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=156646eda779439784ddbc7d1fbd5b90, role_id=5c0bc4258a8348c7afa8b9b712d5cd0b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:48.863111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68aa325-9e8c-47b8-8d07-1a3881950de0 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:48.971375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858d24-57cc-415f-ad21-5d9abb7c52ac None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:48.981608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 293/585] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:17:48 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/156646eda779439784ddbc7d1fbd5b90/roles/5c0bc4258a8348c7afa8b9b712d5cd0b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:48.982794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aa325-9e8c-47b8-8d07-1a3881950de0 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:49.022214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c4d93-0b8c-470a-ba23-b453149369e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:49.024290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c4d93-0b8c-470a-ba23-b453149369e6 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:49.025211 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c4d93-0b8c-470a-ba23-b453149369e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:49.025797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c4d93-0b8c-470a-ba23-b453149369e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:49.042115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c4d93-0b8c-470a-ba23-b453149369e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:49.044910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c4d93-0b8c-470a-ba23-b453149369e6 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-416c4d93-0b8c-470a-ba23-b453149369e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:49.068808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:49.070663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:49.071627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:49.071627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:49.071627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:49.071627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:49.075969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 293/586] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:49.076957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c4d93-0b8c-470a-ba23-b453149369e6 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:49.143603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68aa325-9e8c-47b8-8d07-1a3881950de0 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:49.209849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ba0bd-518a-4cd1-880a-01664b34c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:49.211602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ba0bd-518a-4cd1-880a-01664b34c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:49.212379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ba0bd-518a-4cd1-880a-01664b34c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:49.213131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ba0bd-518a-4cd1-880a-01664b34c1a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:49.226090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ba0bd-518a-4cd1-880a-01664b34c1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:49.228108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ba0bd-518a-4cd1-880a-01664b34c1a8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:49.235849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c4d93-0b8c-470a-ba23-b453149369e6 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-4d7ba0bd-518a-4cd1-880a-01664b34c1a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:49.248013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:49.249114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:49.250060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 294/587] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:49.250754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ba0bd-518a-4cd1-880a-01664b34c1a8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:49.285607 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f468cec-862e-4376-b656-7eeb434fe754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:49.286308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f468cec-862e-4376-b656-7eeb434fe754 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:49.286595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f468cec-862e-4376-b656-7eeb434fe754 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:49.286878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f468cec-862e-4376-b656-7eeb434fe754 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:49.287742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f468cec-862e-4376-b656-7eeb434fe754 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:49.288595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f468cec-862e-4376-b656-7eeb434fe754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:49.290104 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f468cec-862e-4376-b656-7eeb434fe754 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:49.312893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 294/588] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 12 20:17:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:49.314467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f468cec-862e-4376-b656-7eeb434fe754 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:49.384177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ba0bd-518a-4cd1-880a-01664b34c1a8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:49.420863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ea6b0-79ca-41a0-a3bc-ef38bbf92912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:49.421681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ea6b0-79ca-41a0-a3bc-ef38bbf92912 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:49.422045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ea6b0-79ca-41a0-a3bc-ef38bbf92912 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:49.422394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ea6b0-79ca-41a0-a3bc-ef38bbf92912 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:49.423215 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ea6b0-79ca-41a0-a3bc-ef38bbf92912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:49.423604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ea6b0-79ca-41a0-a3bc-ef38bbf92912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:49.425044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ea6b0-79ca-41a0-a3bc-ef38bbf92912 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:49.430850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f468cec-862e-4376-b656-7eeb434fe754 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:49.438195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 295/589] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:49.439251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ea6b0-79ca-41a0-a3bc-ef38bbf92912 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:49.474134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee885d-212c-49bb-be86-6b8e53b8eabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:49.474820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee885d-212c-49bb-be86-6b8e53b8eabc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:49.475103 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee885d-212c-49bb-be86-6b8e53b8eabc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:49.475387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee885d-212c-49bb-be86-6b8e53b8eabc None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:49.477693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee885d-212c-49bb-be86-6b8e53b8eabc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:49.478147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee885d-212c-49bb-be86-6b8e53b8eabc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:49.479648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee885d-212c-49bb-be86-6b8e53b8eabc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:49.504430 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 295/590] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 12 20:17:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:49.505311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee885d-212c-49bb-be86-6b8e53b8eabc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:49.547953 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ea6b0-79ca-41a0-a3bc-ef38bbf92912 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:49.584304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a48d2-b285-41dc-b18a-f7c6452e437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:49.585247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a48d2-b285-41dc-b18a-f7c6452e437a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:49.585633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a48d2-b285-41dc-b18a-f7c6452e437a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:49.585991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a48d2-b285-41dc-b18a-f7c6452e437a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:49.597420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a48d2-b285-41dc-b18a-f7c6452e437a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:49.598983 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a48d2-b285-41dc-b18a-f7c6452e437a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:49.613708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee885d-212c-49bb-be86-6b8e53b8eabc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b61a48d2-b285-41dc-b18a-f7c6452e437a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:49.619387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:49.620510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:49.621781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:49.621781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:49.621781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:49.621781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:49.625305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 296/591] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:49.628127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a48d2-b285-41dc-b18a-f7c6452e437a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:49.653014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d75cb2-dd42-4e66-ad83-7be7ae43edc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:49.653781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d75cb2-dd42-4e66-ad83-7be7ae43edc9 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:49.654062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d75cb2-dd42-4e66-ad83-7be7ae43edc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:49.654339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d75cb2-dd42-4e66-ad83-7be7ae43edc9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:49.662099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d75cb2-dd42-4e66-ad83-7be7ae43edc9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:49.664292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d75cb2-dd42-4e66-ad83-7be7ae43edc9 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-15d75cb2-dd42-4e66-ad83-7be7ae43edc9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:49.681880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:49.683099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 296/592] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:49.684354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d75cb2-dd42-4e66-ad83-7be7ae43edc9 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:49.739352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a48d2-b285-41dc-b18a-f7c6452e437a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:49.775710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fdd31-ce5f-453b-b017-54d0b7464c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:49.776797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fdd31-ce5f-453b-b017-54d0b7464c8c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:49.777234 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fdd31-ce5f-453b-b017-54d0b7464c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:49.777768 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fdd31-ce5f-453b-b017-54d0b7464c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:49.789328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fdd31-ce5f-453b-b017-54d0b7464c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:49.791045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fdd31-ce5f-453b-b017-54d0b7464c8c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:49.792629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d75cb2-dd42-4e66-ad83-7be7ae43edc9 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-152fdd31-ce5f-453b-b017-54d0b7464c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:49.810191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:49.811337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:49.812456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:49.812456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:49.812456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:49.812456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:49.814471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 297/593] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:49.815559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fdd31-ce5f-453b-b017-54d0b7464c8c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:49.835762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd6a10-fcac-4f77-bede-500927710c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:49.836438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd6a10-fcac-4f77-bede-500927710c2e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:49.836779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd6a10-fcac-4f77-bede-500927710c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:49.837240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd6a10-fcac-4f77-bede-500927710c2e None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:49.837821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd6a10-fcac-4f77-bede-500927710c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:49.838129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd6a10-fcac-4f77-bede-500927710c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:49.839643 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd6a10-fcac-4f77-bede-500927710c2e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:49.858409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 297/594] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:49.858409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd6a10-fcac-4f77-bede-500927710c2e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:49.961391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fdd31-ce5f-453b-b017-54d0b7464c8c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:49.965308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd6a10-fcac-4f77-bede-500927710c2e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:50.003550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312988a9-29f0-45f8-baff-bcf1a993cdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:50.004568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312988a9-29f0-45f8-baff-bcf1a993cdfc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:50.004862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312988a9-29f0-45f8-baff-bcf1a993cdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:50.005141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312988a9-29f0-45f8-baff-bcf1a993cdfc None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:50.006192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312988a9-29f0-45f8-baff-bcf1a993cdfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:50.006500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312988a9-29f0-45f8-baff-bcf1a993cdfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:50.009337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312988a9-29f0-45f8-baff-bcf1a993cdfc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:50.014325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18de3e1-f472-4d8c-a497-cfb86a6b2e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:50.015455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18de3e1-f472-4d8c-a497-cfb86a6b2e8f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:50.015889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18de3e1-f472-4d8c-a497-cfb86a6b2e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:50.017691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18de3e1-f472-4d8c-a497-cfb86a6b2e8f None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:50.017691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18de3e1-f472-4d8c-a497-cfb86a6b2e8f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:50.017691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18de3e1-f472-4d8c-a497-cfb86a6b2e8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:50.019394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18de3e1-f472-4d8c-a497-cfb86a6b2e8f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:50.024595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 298/595] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:50.025503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312988a9-29f0-45f8-baff-bcf1a993cdfc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:50.047538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 298/596] 10.222.0.59 () {56 vars in 1139 bytes} [Thu May 12 20:17:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:50.049134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18de3e1-f472-4d8c-a497-cfb86a6b2e8f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:50.157957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18de3e1-f472-4d8c-a497-cfb86a6b2e8f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:50.166469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312988a9-29f0-45f8-baff-bcf1a993cdfc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:50.203301 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d88498-d7fe-45bd-b0e4-18851d6bdd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:50.204112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d88498-d7fe-45bd-b0e4-18851d6bdd42 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:50.204397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d88498-d7fe-45bd-b0e4-18851d6bdd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:50.204673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d88498-d7fe-45bd-b0e4-18851d6bdd42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:50.211183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aabdd-6d26-4882-93c1-5871a482d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:50.212248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aabdd-6d26-4882-93c1-5871a482d376 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:50.212694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aabdd-6d26-4882-93c1-5871a482d376 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:50.213115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aabdd-6d26-4882-93c1-5871a482d376 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:50.213935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d88498-d7fe-45bd-b0e4-18851d6bdd42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:50.215913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d88498-d7fe-45bd-b0e4-18851d6bdd42 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:50.221329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526aabdd-6d26-4882-93c1-5871a482d376 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:50.223236 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526aabdd-6d26-4882-93c1-5871a482d376 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c3d88498-d7fe-45bd-b0e4-18851d6bdd42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:50.233704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:50.234647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:50.235545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:50.235545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:50.235545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:50.235545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:50.235545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:50.235545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:50.235545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:50.235545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:50.239613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 299/597] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:50.240561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d88498-d7fe-45bd-b0e4-18851d6bdd42 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-526aabdd-6d26-4882-93c1-5871a482d376 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:50.245473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:50.246451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:50.247320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:50.247320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:50.247320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:50.247320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:50.247320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:50.247320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:50.247320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:50.247320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:50.254226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 299/598] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:50.255634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aabdd-6d26-4882-93c1-5871a482d376 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:50.361693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d88498-d7fe-45bd-b0e4-18851d6bdd42 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:50.395381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aabdd-6d26-4882-93c1-5871a482d376 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:50.398436 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8f52-b18e-4a18-a5f8-d3f70417a5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:50.398997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8f52-b18e-4a18-a5f8-d3f70417a5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:50.399281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8f52-b18e-4a18-a5f8-d3f70417a5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:50.400384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8f52-b18e-4a18-a5f8-d3f70417a5f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:50.410744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c8f52-b18e-4a18-a5f8-d3f70417a5f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:50.412236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c8f52-b18e-4a18-a5f8-d3f70417a5f3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-556c8f52-b18e-4a18-a5f8-d3f70417a5f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:50.433633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:50.434579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:50.435607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:50.435607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:50.435607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:50.435607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:50.435607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 300/599] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:50.436514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8f52-b18e-4a18-a5f8-d3f70417a5f3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:50.442444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ff3aa-13a3-4314-a942-9ace692bf6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:50.443541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ff3aa-13a3-4314-a942-9ace692bf6db None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:50.444085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ff3aa-13a3-4314-a942-9ace692bf6db None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:50.445197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ff3aa-13a3-4314-a942-9ace692bf6db None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:50.446355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ff3aa-13a3-4314-a942-9ace692bf6db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:50.447586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ff3aa-13a3-4314-a942-9ace692bf6db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:50.449598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ff3aa-13a3-4314-a942-9ace692bf6db None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:50.475234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 300/600] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:50.478272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ff3aa-13a3-4314-a942-9ace692bf6db None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:50.571142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8f52-b18e-4a18-a5f8-d3f70417a5f3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:50.594897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ff3aa-13a3-4314-a942-9ace692bf6db None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:50.613069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8baf8-d688-44c6-b954-7d6bfedbe1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:50.613069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8baf8-d688-44c6-b954-7d6bfedbe1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:50.613539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8baf8-d688-44c6-b954-7d6bfedbe1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:50.613726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8baf8-d688-44c6-b954-7d6bfedbe1b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:50.614562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8baf8-d688-44c6-b954-7d6bfedbe1b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:50.614832 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8baf8-d688-44c6-b954-7d6bfedbe1b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:50.616301 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8baf8-d688-44c6-b954-7d6bfedbe1b9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:50.633432 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 301/601] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:50.634324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8baf8-d688-44c6-b954-7d6bfedbe1b9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:50.634678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b80935-68e6-47f0-bae3-3617d39aae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:50.635634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b80935-68e6-47f0-bae3-3617d39aae3e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:50.636127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b80935-68e6-47f0-bae3-3617d39aae3e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:50.636607 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b80935-68e6-47f0-bae3-3617d39aae3e None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:50.637557 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b80935-68e6-47f0-bae3-3617d39aae3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:50.638061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b80935-68e6-47f0-bae3-3617d39aae3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:50.639832 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b80935-68e6-47f0-bae3-3617d39aae3e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:50.653492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 301/602] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:50.654688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b80935-68e6-47f0-bae3-3617d39aae3e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:50.758523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8baf8-d688-44c6-b954-7d6bfedbe1b9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:50.768361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b80935-68e6-47f0-bae3-3617d39aae3e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:50.801882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70def2b-2e84-4f77-b720-4177bb4a48bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:50.802997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70def2b-2e84-4f77-b720-4177bb4a48bd None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:50.803292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70def2b-2e84-4f77-b720-4177bb4a48bd None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:50.803630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70def2b-2e84-4f77-b720-4177bb4a48bd None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/a32db19a943345b6ba1c91e79739835f/roles/5c0bc4258a8348c7afa8b9b712d5cd0b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:50.808974 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06ddf6-6af2-4489-b4da-50b76a95b22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:50.810221 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ddf6-6af2-4489-b4da-50b76a95b22e None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:50.810758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ddf6-6af2-4489-b4da-50b76a95b22e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:50.811302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ddf6-6af2-4489-b4da-50b76a95b22e None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/1f8ec4765e05461a98b3c9eb1d3ced5d/roles/5c0bc4258a8348c7afa8b9b712d5cd0b` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:50.823893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70def2b-2e84-4f77-b720-4177bb4a48bd None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=a32db19a943345b6ba1c91e79739835f, role_id=5c0bc4258a8348c7afa8b9b712d5cd0b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:50.826450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70def2b-2e84-4f77-b720-4177bb4a48bd None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:50.828743 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06ddf6-6af2-4489-b4da-50b76a95b22e None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=1f8ec4765e05461a98b3c9eb1d3ced5d, role_id=5c0bc4258a8348c7afa8b9b712d5cd0b)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:50.830461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06ddf6-6af2-4489-b4da-50b76a95b22e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:50.929356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 302/603] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:17:50 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/a32db19a943345b6ba1c91e79739835f/roles/5c0bc4258a8348c7afa8b9b712d5cd0b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:50.929356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70def2b-2e84-4f77-b720-4177bb4a48bd None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:50.956661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 302/604] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:17:50 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/1f8ec4765e05461a98b3c9eb1d3ced5d/roles/5c0bc4258a8348c7afa8b9b712d5cd0b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:51.105268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70def2b-2e84-4f77-b720-4177bb4a48bd None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:51.163854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1a32-cfba-4b1e-a5db-88a0894cde2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:51.164711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1a32-cfba-4b1e-a5db-88a0894cde2a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:51.164993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1a32-cfba-4b1e-a5db-88a0894cde2a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:51.165268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1a32-cfba-4b1e-a5db-88a0894cde2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:51.173219 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e1a32-cfba-4b1e-a5db-88a0894cde2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:51.174776 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e1a32-cfba-4b1e-a5db-88a0894cde2a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-769e1a32-cfba-4b1e-a5db-88a0894cde2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:51.191146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:51.192094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:51.193018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:51.193018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:51.193018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:51.193018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:51.193018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:51.193018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:51.193018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:51.193018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:51.193018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 303/605] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:51.199748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06ddf6-6af2-4489-b4da-50b76a95b22e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:51.391195 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06ddf6-6af2-4489-b4da-50b76a95b22e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:51.440800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12c85-cff1-439f-996c-4933de720c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:51.441646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12c85-cff1-439f-996c-4933de720c6a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:51.441887 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12c85-cff1-439f-996c-4933de720c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:51.442118 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12c85-cff1-439f-996c-4933de720c6a None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:51.442932 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd12c85-cff1-439f-996c-4933de720c6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:51.443246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd12c85-cff1-439f-996c-4933de720c6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:51.445585 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd12c85-cff1-439f-996c-4933de720c6a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:51.460622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 303/606] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:51.466791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1a32-cfba-4b1e-a5db-88a0894cde2a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:51.611939 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffddef-f5cb-4e44-bcf4-96bbc9dce2fa None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:51.612402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffddef-f5cb-4e44-bcf4-96bbc9dce2fa None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:51.612879 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffddef-f5cb-4e44-bcf4-96bbc9dce2fa None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:51.615487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 304/607] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:51.623158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd424c4-3ab8-4255-8830-3c9b16f70873 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:51.623986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd424c4-3ab8-4255-8830-3c9b16f70873 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:51.624797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd424c4-3ab8-4255-8830-3c9b16f70873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:51.658722 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-bbd424c4-3ab8-4255-8830-3c9b16f70873 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:51.661833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bbd424c4-3ab8-4255-8830-3c9b16f70873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:51.709217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1a32-cfba-4b1e-a5db-88a0894cde2a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:51.767807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067c542-7626-4853-a345-6355f3aa8b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:51.769141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067c542-7626-4853-a345-6355f3aa8b98 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:51.769652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067c542-7626-4853-a345-6355f3aa8b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:51.770486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067c542-7626-4853-a345-6355f3aa8b98 None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/4379d3e8b38645978efb08ea6f560fc0/roles/5c0bc4258a8348c7afa8b9b712d5cd0b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:51.790506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067c542-7626-4853-a345-6355f3aa8b98 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=4379d3e8b38645978efb08ea6f560fc0, role_id=5c0bc4258a8348c7afa8b9b712d5cd0b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:51.791838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067c542-7626-4853-a345-6355f3aa8b98 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:51.800900 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 305/608] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:51.803136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f0b88-9c58-490f-a75f-44816d995af4 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:51.803702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f0b88-9c58-490f-a75f-44816d995af4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:51.804267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f0b88-9c58-490f-a75f-44816d995af4 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:51.806500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 306/609] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:51.814529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9071-3e5f-4361-b470-0d690757ff2c None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:51.814766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9071-3e5f-4361-b470-0d690757ff2c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:51.818574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9071-3e5f-4361-b470-0d690757ff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:51.842100 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-ca9d9071-3e5f-4361-b470-0d690757ff2c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:51.844940 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ca9d9071-3e5f-4361-b470-0d690757ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:51.910017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 304/610] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:17:51 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/4379d3e8b38645978efb08ea6f560fc0/roles/5c0bc4258a8348c7afa8b9b712d5cd0b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:51.918944 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067c542-7626-4853-a345-6355f3aa8b98 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:51.980640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 307/611] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:17:52.020947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d9071-3e5f-4361-b470-0d690757ff2c None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:52.090450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067c542-7626-4853-a345-6355f3aa8b98 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:52.139633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f81d3-bea8-45f9-821c-70a8e0e176c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:52.140838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f81d3-bea8-45f9-821c-70a8e0e176c6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:52.141381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f81d3-bea8-45f9-821c-70a8e0e176c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:52.141668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f81d3-bea8-45f9-821c-70a8e0e176c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:52.172834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f81d3-bea8-45f9-821c-70a8e0e176c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-334f81d3-bea8-45f9-821c-70a8e0e176c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:52.182251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:52.183407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:52.184886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 305/612] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:52.191728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f81d3-bea8-45f9-821c-70a8e0e176c6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:52.236233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d9071-3e5f-4361-b470-0d690757ff2c None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:52.288325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646b4dc-9298-4738-8ff4-c6c1b863e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:52.290221 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646b4dc-9298-4738-8ff4-c6c1b863e232 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:52.291005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646b4dc-9298-4738-8ff4-c6c1b863e232 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:52.291770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646b4dc-9298-4738-8ff4-c6c1b863e232 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:52.314041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646b4dc-9298-4738-8ff4-c6c1b863e232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-9646b4dc-9298-4738-8ff4-c6c1b863e232 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:52.326641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:52.328133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:52.329250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:52.331346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 308/613] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:52.339448 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646b4dc-9298-4738-8ff4-c6c1b863e232 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:52.374688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f81d3-bea8-45f9-821c-70a8e0e176c6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:52.430361 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa438d83-a5a3-4b1a-9dd9-17374d0851fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:52.430971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438d83-a5a3-4b1a-9dd9-17374d0851fc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:52.431256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438d83-a5a3-4b1a-9dd9-17374d0851fc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:52.431532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438d83-a5a3-4b1a-9dd9-17374d0851fc None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:52.432286 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa438d83-a5a3-4b1a-9dd9-17374d0851fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:52.432596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa438d83-a5a3-4b1a-9dd9-17374d0851fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:52.434015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa438d83-a5a3-4b1a-9dd9-17374d0851fc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:52.445559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 306/614] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:52.452181 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa438d83-a5a3-4b1a-9dd9-17374d0851fc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:52.535995 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646b4dc-9298-4738-8ff4-c6c1b863e232 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:52.592741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0697-4eec-4883-981b-33cab39f6d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:52.593457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0697-4eec-4883-981b-33cab39f6d2c None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:52.593739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0697-4eec-4883-981b-33cab39f6d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:52.594013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0697-4eec-4883-981b-33cab39f6d2c None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:52.594771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b0697-4eec-4883-981b-33cab39f6d2c None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:52.595446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b0697-4eec-4883-981b-33cab39f6d2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:52.597009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b0697-4eec-4883-981b-33cab39f6d2c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:52.608514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 309/615] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:52.618091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0697-4eec-4883-981b-33cab39f6d2c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:52.679165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa438d83-a5a3-4b1a-9dd9-17374d0851fc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:52.766915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0697-4eec-4883-981b-33cab39f6d2c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:52.771543 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677e87-de5e-4969-a245-343bce280518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:52.773403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677e87-de5e-4969-a245-343bce280518 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:52.774077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677e87-de5e-4969-a245-343bce280518 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:52.775323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677e87-de5e-4969-a245-343bce280518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:52.804934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677e87-de5e-4969-a245-343bce280518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:52.807062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677e87-de5e-4969-a245-343bce280518 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-94677e87-de5e-4969-a245-343bce280518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:52.835372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:52.836718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:52.837810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:52.837810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:52.837810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:52.837810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:52.839679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 307/616] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:52.846718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677e87-de5e-4969-a245-343bce280518 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:52.873309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9eec9-a1ea-4c7f-9c97-9e72abce0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:52.873309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9eec9-a1ea-4c7f-9c97-9e72abce0491 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:52.873309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9eec9-a1ea-4c7f-9c97-9e72abce0491 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:52.873309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9eec9-a1ea-4c7f-9c97-9e72abce0491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:52.887136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9eec9-a1ea-4c7f-9c97-9e72abce0491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:52.889069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9eec9-a1ea-4c7f-9c97-9e72abce0491 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-34b9eec9-a1ea-4c7f-9c97-9e72abce0491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:52.916937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:52.917898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:52.918845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:52.918845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:52.918845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:52.918845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:52.920912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 310/617] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:52.930375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9eec9-a1ea-4c7f-9c97-9e72abce0491 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:53.025557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677e87-de5e-4969-a245-343bce280518 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:53.070364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ab266-9215-4f8c-9637-2216f25e0bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:53.071053 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ab266-9215-4f8c-9637-2216f25e0bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:53.071345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ab266-9215-4f8c-9637-2216f25e0bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:53.071632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ab266-9215-4f8c-9637-2216f25e0bb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:53.072531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ab266-9215-4f8c-9637-2216f25e0bb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:53.072846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ab266-9215-4f8c-9637-2216f25e0bb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:53.074283 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ab266-9215-4f8c-9637-2216f25e0bb5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:53.094759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 308/618] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:53.101789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ab266-9215-4f8c-9637-2216f25e0bb5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:53.239404 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ab266-9215-4f8c-9637-2216f25e0bb5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:53.264417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9eec9-a1ea-4c7f-9c97-9e72abce0491 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:53.295303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de658e-f7ab-4720-a3bf-8e0f402e5584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:53.297004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de658e-f7ab-4720-a3bf-8e0f402e5584 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:53.297312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de658e-f7ab-4720-a3bf-8e0f402e5584 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:53.297602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de658e-f7ab-4720-a3bf-8e0f402e5584 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:53.309526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de658e-f7ab-4720-a3bf-8e0f402e5584 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:53.311874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de658e-f7ab-4720-a3bf-8e0f402e5584 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-04de658e-f7ab-4720-a3bf-8e0f402e5584 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:53.334500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:53.337001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:53.339362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 309/619] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 12 20:17:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:17:53.342405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de658e-f7ab-4720-a3bf-8e0f402e5584 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:53.358493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adcfcc-3d85-4e78-879d-2756807b2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:53.359171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adcfcc-3d85-4e78-879d-2756807b2188 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:53.359456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adcfcc-3d85-4e78-879d-2756807b2188 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:53.359737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adcfcc-3d85-4e78-879d-2756807b2188 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:53.360469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adcfcc-3d85-4e78-879d-2756807b2188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:53.360776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adcfcc-3d85-4e78-879d-2756807b2188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:53.362263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adcfcc-3d85-4e78-879d-2756807b2188 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:53.391533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 311/620] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:53.397090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adcfcc-3d85-4e78-879d-2756807b2188 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:53.466122 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de658e-f7ab-4720-a3bf-8e0f402e5584 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:53.524089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aec0b5-1bd2-4308-8ce9-56f7764bcc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:53.525113 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec0b5-1bd2-4308-8ce9-56f7764bcc06 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:53.525581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec0b5-1bd2-4308-8ce9-56f7764bcc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:53.526001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aec0b5-1bd2-4308-8ce9-56f7764bcc06 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:53.527362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aec0b5-1bd2-4308-8ce9-56f7764bcc06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:53.527899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aec0b5-1bd2-4308-8ce9-56f7764bcc06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:53.530321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aec0b5-1bd2-4308-8ce9-56f7764bcc06 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:53.561299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 310/621] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 12 20:17:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:53.568280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aec0b5-1bd2-4308-8ce9-56f7764bcc06 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:53.633765 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adcfcc-3d85-4e78-879d-2756807b2188 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:53.704640 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aec0b5-1bd2-4308-8ce9-56f7764bcc06 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:53.728643 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf593e6-a2e5-4a90-afdc-847f1efe607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:53.729916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf593e6-a2e5-4a90-afdc-847f1efe607c None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:53.730409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf593e6-a2e5-4a90-afdc-847f1efe607c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:53.730977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf593e6-a2e5-4a90-afdc-847f1efe607c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:53.750516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf593e6-a2e5-4a90-afdc-847f1efe607c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:53.752340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf593e6-a2e5-4a90-afdc-847f1efe607c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:53.754895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3ef3-d1b4-4ad5-9ab8-ed0875e2a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:53.755646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3ef3-d1b4-4ad5-9ab8-ed0875e2a939 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:53.755978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3ef3-d1b4-4ad5-9ab8-ed0875e2a939 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:53.757078 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3ef3-d1b4-4ad5-9ab8-ed0875e2a939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-ecf593e6-a2e5-4a90-afdc-847f1efe607c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:53.786710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:53.787746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:53.789797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 312/622] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:17:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:53.794114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf593e6-a2e5-4a90-afdc-847f1efe607c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:53.846870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de3ef3-d1b4-4ad5-9ab8-ed0875e2a939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:53.848432 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de3ef3-d1b4-4ad5-9ab8-ed0875e2a939 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:53.994592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 311/623] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:54.000168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3ef3-d1b4-4ad5-9ab8-ed0875e2a939 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:54.044643 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf593e6-a2e5-4a90-afdc-847f1efe607c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:54.104603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3ef3-d1b4-4ad5-9ab8-ed0875e2a939 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:54.107346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fa423-2b2c-49f0-af42-8d9fa5424d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:54.108037 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fa423-2b2c-49f0-af42-8d9fa5424d24 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.108329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fa423-2b2c-49f0-af42-8d9fa5424d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.108612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fa423-2b2c-49f0-af42-8d9fa5424d24 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.109565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fa423-2b2c-49f0-af42-8d9fa5424d24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:54.109880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fa423-2b2c-49f0-af42-8d9fa5424d24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:54.111331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fa423-2b2c-49f0-af42-8d9fa5424d24 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:54.131034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 313/624] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 12 20:17:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:17:54.138429 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fa423-2b2c-49f0-af42-8d9fa5424d24 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:54.164794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34913274-ed4e-439e-845a-83b84097420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:54.165814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34913274-ed4e-439e-845a-83b84097420d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.166583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34913274-ed4e-439e-845a-83b84097420d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.166866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34913274-ed4e-439e-845a-83b84097420d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.180364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34913274-ed4e-439e-845a-83b84097420d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:54.181908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34913274-ed4e-439e-845a-83b84097420d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-34913274-ed4e-439e-845a-83b84097420d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:54.201245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:54.202216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:54.203725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:54.203725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:54.203725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:54.203725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:54.203725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 312/625] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:54.204202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce462c-d71f-46a1-94f0-bbf89dea1e8c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.204584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce462c-d71f-46a1-94f0-bbf89dea1e8c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.204829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce462c-d71f-46a1-94f0-bbf89dea1e8c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.211846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 313/626] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:54.213349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce462c-d71f-46a1-94f0-bbf89dea1e8c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:54.263208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fa423-2b2c-49f0-af42-8d9fa5424d24 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:54.312772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d815e-c1fe-41d7-b3f9-de28f870caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:54.313739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d815e-c1fe-41d7-b3f9-de28f870caed None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.313981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d815e-c1fe-41d7-b3f9-de28f870caed None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.314267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d815e-c1fe-41d7-b3f9-de28f870caed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.330829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d815e-c1fe-41d7-b3f9-de28f870caed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:54.333372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d815e-c1fe-41d7-b3f9-de28f870caed None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-6a4d815e-c1fe-41d7-b3f9-de28f870caed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:54.353902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:54.356374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:54.358714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:54.358714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:54.358714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:54.358714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:54.365595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 314/627] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:54.365595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591be3e-696b-46cb-8d20-3f5ceb7075a5 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.365595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591be3e-696b-46cb-8d20-3f5ceb7075a5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.365595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591be3e-696b-46cb-8d20-3f5ceb7075a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.374313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce462c-d71f-46a1-94f0-bbf89dea1e8c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:54.379893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5591be3e-696b-46cb-8d20-3f5ceb7075a5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:54.381239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5591be3e-696b-46cb-8d20-3f5ceb7075a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:54.416817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0c52b-4062-4262-b47a-9923000c43c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:54.422572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0c52b-4062-4262-b47a-9923000c43c8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.422887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0c52b-4062-4262-b47a-9923000c43c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.424465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0c52b-4062-4262-b47a-9923000c43c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.425465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0c52b-4062-4262-b47a-9923000c43c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:54.426063 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0c52b-4062-4262-b47a-9923000c43c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:54.428918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0c52b-4062-4262-b47a-9923000c43c8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:54.445379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 314/628] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:54.446349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0c52b-4062-4262-b47a-9923000c43c8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:54.462623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 315/629] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:54.463661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591be3e-696b-46cb-8d20-3f5ceb7075a5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:54.552898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0c52b-4062-4262-b47a-9923000c43c8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:54.579888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591be3e-696b-46cb-8d20-3f5ceb7075a5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:54.598870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebf990-206b-45a7-93da-7d8d8265cf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:54.599559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebf990-206b-45a7-93da-7d8d8265cf54 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.599848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebf990-206b-45a7-93da-7d8d8265cf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.601030 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebf990-206b-45a7-93da-7d8d8265cf54 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.601824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebf990-206b-45a7-93da-7d8d8265cf54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:54.602141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebf990-206b-45a7-93da-7d8d8265cf54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:54.603518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebf990-206b-45a7-93da-7d8d8265cf54 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:54.621428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 315/630] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:54.621428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebf990-206b-45a7-93da-7d8d8265cf54 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:54.628316 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c34ae6-c4d5-4d44-aa47-43b01313a9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:54.629489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c34ae6-c4d5-4d44-aa47-43b01313a9cb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.630026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c34ae6-c4d5-4d44-aa47-43b01313a9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.630471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c34ae6-c4d5-4d44-aa47-43b01313a9cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.639738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c34ae6-c4d5-4d44-aa47-43b01313a9cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:54.641454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c34ae6-c4d5-4d44-aa47-43b01313a9cb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-e8c34ae6-c4d5-4d44-aa47-43b01313a9cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:54.668780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:54.670147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:54.671044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:54.671044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:54.671044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:54.671044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:54.671044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:54.671044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:54.671044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:54.671044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:54.673586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 316/631] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:54.679707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45690d54-3766-47ee-8a6b-6d2e08757906 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.679707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45690d54-3766-47ee-8a6b-6d2e08757906 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.679707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45690d54-3766-47ee-8a6b-6d2e08757906 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.679707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 317/632] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:54.679707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45690d54-3766-47ee-8a6b-6d2e08757906 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:54.754189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebf990-206b-45a7-93da-7d8d8265cf54 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:54.781921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45690d54-3766-47ee-8a6b-6d2e08757906 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:54.791394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e28c1-9782-4cdc-8166-dbd80ba1db31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:54.792831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e28c1-9782-4cdc-8166-dbd80ba1db31 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.793675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e28c1-9782-4cdc-8166-dbd80ba1db31 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.794475 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e28c1-9782-4cdc-8166-dbd80ba1db31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.807874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e28c1-9782-4cdc-8166-dbd80ba1db31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:54.816110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0d9c3-935a-4e82-8d1c-8eedadd9fdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:54.816927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0d9c3-935a-4e82-8d1c-8eedadd9fdaf None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.817212 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0d9c3-935a-4e82-8d1c-8eedadd9fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.817522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0d9c3-935a-4e82-8d1c-8eedadd9fdaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-082e28c1-9782-4cdc-8166-dbd80ba1db31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:54.819556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:54.820677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:54.821552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:54.823338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 316/633] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:54.823637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e28c1-9782-4cdc-8166-dbd80ba1db31 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:54.829528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0d9c3-935a-4e82-8d1c-8eedadd9fdaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:54.831021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0d9c3-935a-4e82-8d1c-8eedadd9fdaf None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-42f0d9c3-935a-4e82-8d1c-8eedadd9fdaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:54.846689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:54.847677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:54.848555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:54.848555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:54.848555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:54.848555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:54.848555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:54.848555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:54.848555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:54.848555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:54.848555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 318/634] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:54.854089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e40e-eef0-4117-a783-97d6799c6283 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.854381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e40e-eef0-4117-a783-97d6799c6283 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.854666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e40e-eef0-4117-a783-97d6799c6283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.873366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8b64e40e-eef0-4117-a783-97d6799c6283 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:54.874504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8b64e40e-eef0-4117-a783-97d6799c6283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:54.939259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e28c1-9782-4cdc-8166-dbd80ba1db31 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:54.942439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 319/635] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:54.943106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64e40e-eef0-4117-a783-97d6799c6283 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:54.982467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127150b1-3f7e-41ce-bf89-66254c89bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:54.983139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127150b1-3f7e-41ce-bf89-66254c89bd76 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:54.983428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127150b1-3f7e-41ce-bf89-66254c89bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:54.983710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127150b1-3f7e-41ce-bf89-66254c89bd76 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:54.984500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127150b1-3f7e-41ce-bf89-66254c89bd76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:54.984811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127150b1-3f7e-41ce-bf89-66254c89bd76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:54.986280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127150b1-3f7e-41ce-bf89-66254c89bd76 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:54.998993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 317/636] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:54.999811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127150b1-3f7e-41ce-bf89-66254c89bd76 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.048315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64e40e-eef0-4117-a783-97d6799c6283 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.081316 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a097f-dbcc-4e66-9d78-7604534e0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.081977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a097f-dbcc-4e66-9d78-7604534e0fdf None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.082259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a097f-dbcc-4e66-9d78-7604534e0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.082542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a097f-dbcc-4e66-9d78-7604534e0fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.083275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a097f-dbcc-4e66-9d78-7604534e0fdf None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:55.083577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a097f-dbcc-4e66-9d78-7604534e0fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:55.085688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a097f-dbcc-4e66-9d78-7604534e0fdf None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:55.093203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 320/637] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:55.093821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127150b1-3f7e-41ce-bf89-66254c89bd76 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.093999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a097f-dbcc-4e66-9d78-7604534e0fdf None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.127138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6199-7097-4d4a-8ae1-0a4dc0ca50c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.127718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6199-7097-4d4a-8ae1-0a4dc0ca50c1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.128000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6199-7097-4d4a-8ae1-0a4dc0ca50c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.128273 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6199-7097-4d4a-8ae1-0a4dc0ca50c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.129049 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6199-7097-4d4a-8ae1-0a4dc0ca50c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:55.129385 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6199-7097-4d4a-8ae1-0a4dc0ca50c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:55.130801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6199-7097-4d4a-8ae1-0a4dc0ca50c1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:55.141982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 318/638] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:55.142797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6199-7097-4d4a-8ae1-0a4dc0ca50c1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.192665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a097f-dbcc-4e66-9d78-7604534e0fdf None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.230640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808eecb-dfed-41dd-823d-9d6fc2e73d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.231531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808eecb-dfed-41dd-823d-9d6fc2e73d1b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.231815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808eecb-dfed-41dd-823d-9d6fc2e73d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.232082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808eecb-dfed-41dd-823d-9d6fc2e73d1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.239925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6199-7097-4d4a-8ae1-0a4dc0ca50c1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.242939 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808eecb-dfed-41dd-823d-9d6fc2e73d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-8808eecb-dfed-41dd-823d-9d6fc2e73d1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:55.250829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:55.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:55.252733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 321/639] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:55.253623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce5617-f76e-4487-bcc7-708376425b21 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.253840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce5617-f76e-4487-bcc7-708376425b21 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.254320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce5617-f76e-4487-bcc7-708376425b21 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.255345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 322/640] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:55.256204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce5617-f76e-4487-bcc7-708376425b21 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.279984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e6be-8f12-46ed-94f4-0c722f8edfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.280725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e6be-8f12-46ed-94f4-0c722f8edfff None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.281102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e6be-8f12-46ed-94f4-0c722f8edfff None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.281460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e6be-8f12-46ed-94f4-0c722f8edfff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.282303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e6be-8f12-46ed-94f4-0c722f8edfff None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=156646eda779439784ddbc7d1fbd5b90) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:55.282620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e6be-8f12-46ed-94f4-0c722f8edfff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:55.284041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e6be-8f12-46ed-94f4-0c722f8edfff None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:55.291460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 319/641] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:55 2022] GET /identity/v3/role_assignments?user.id=156646eda779439784ddbc7d1fbd5b90&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:55.292242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e6be-8f12-46ed-94f4-0c722f8edfff None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.387812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce5617-f76e-4487-bcc7-708376425b21 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.406409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e6be-8f12-46ed-94f4-0c722f8edfff None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.426882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ade549-5b32-46c2-9167-8ee2ad4f81e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.427707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ade549-5b32-46c2-9167-8ee2ad4f81e7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.427993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ade549-5b32-46c2-9167-8ee2ad4f81e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.428864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ade549-5b32-46c2-9167-8ee2ad4f81e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.439933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ade549-5b32-46c2-9167-8ee2ad4f81e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:55.441466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ade549-5b32-46c2-9167-8ee2ad4f81e7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:55.443349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9ef37-b137-4648-b48d-6b7ecd5be595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.444559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9ef37-b137-4648-b48d-6b7ecd5be595 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.444851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9ef37-b137-4648-b48d-6b7ecd5be595 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.445130 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9ef37-b137-4648-b48d-6b7ecd5be595 None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/766497e7e0614adea5769b05f0c1cdcf/roles/5c0bc4258a8348c7afa8b9b712d5cd0b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-c5ade549-5b32-46c2-9167-8ee2ad4f81e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:55.461073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:55.462146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:55.463134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:55.463134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:55.463134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:55.463134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:55.463381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9ef37-b137-4648-b48d-6b7ecd5be595 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=766497e7e0614adea5769b05f0c1cdcf, role_id=5c0bc4258a8348c7afa8b9b712d5cd0b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:55.463458 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 323/642] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:55.464087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ade549-5b32-46c2-9167-8ee2ad4f81e7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.467319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9ef37-b137-4648-b48d-6b7ecd5be595 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:55.538701 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 320/643] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:17:55 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/766497e7e0614adea5769b05f0c1cdcf/roles/5c0bc4258a8348c7afa8b9b712d5cd0b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:17:55.540088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aa8d5-dd92-4fca-9214-aa46e79b8fa7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.540453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aa8d5-dd92-4fca-9214-aa46e79b8fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.540654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aa8d5-dd92-4fca-9214-aa46e79b8fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.558879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-440aa8d5-dd92-4fca-9214-aa46e79b8fa7 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:55.559985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-440aa8d5-dd92-4fca-9214-aa46e79b8fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:55.578394 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ade549-5b32-46c2-9167-8ee2ad4f81e7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.621923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6e3a8-23f7-49dd-b838-92b842df43b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.622619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6e3a8-23f7-49dd-b838-92b842df43b9 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.622911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6e3a8-23f7-49dd-b838-92b842df43b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.623191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6e3a8-23f7-49dd-b838-92b842df43b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.623972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6e3a8-23f7-49dd-b838-92b842df43b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:55.624290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6e3a8-23f7-49dd-b838-92b842df43b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:55.625770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6e3a8-23f7-49dd-b838-92b842df43b9 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:55.635246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 324/644] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:55.636133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6e3a8-23f7-49dd-b838-92b842df43b9 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.643439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 321/645] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:55.644622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aa8d5-dd92-4fca-9214-aa46e79b8fa7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.747335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6e3a8-23f7-49dd-b838-92b842df43b9 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.751678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aa8d5-dd92-4fca-9214-aa46e79b8fa7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.784085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff73079-bac1-4c35-b3be-8a7dd854a46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.785064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff73079-bac1-4c35-b3be-8a7dd854a46d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.785559 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff73079-bac1-4c35-b3be-8a7dd854a46d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.786044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff73079-bac1-4c35-b3be-8a7dd854a46d None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.786957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff73079-bac1-4c35-b3be-8a7dd854a46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:55.787443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff73079-bac1-4c35-b3be-8a7dd854a46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:55.790285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff73079-bac1-4c35-b3be-8a7dd854a46d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:55.798921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecd90c-9755-45d9-bf3c-50688d2fe4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.799731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecd90c-9755-45d9-bf3c-50688d2fe4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.800016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecd90c-9755-45d9-bf3c-50688d2fe4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.800292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecd90c-9755-45d9-bf3c-50688d2fe4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.803950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 325/646] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:55.804886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff73079-bac1-4c35-b3be-8a7dd854a46d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.812570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecd90c-9755-45d9-bf3c-50688d2fe4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:55.814427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecd90c-9755-45d9-bf3c-50688d2fe4d1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-02ecd90c-9755-45d9-bf3c-50688d2fe4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:55.833254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:55.834206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:55.835366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:55.835366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:55.835366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:55.835366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:55.837647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 322/647] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:55.838660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecd90c-9755-45d9-bf3c-50688d2fe4d1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.909217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff73079-bac1-4c35-b3be-8a7dd854a46d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.944272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2de56-5c27-495c-ba45-27600aa57461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.945084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2de56-5c27-495c-ba45-27600aa57461 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.945564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2de56-5c27-495c-ba45-27600aa57461 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.945672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2de56-5c27-495c-ba45-27600aa57461 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:55.951798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecd90c-9755-45d9-bf3c-50688d2fe4d1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:55.956063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2de56-5c27-495c-ba45-27600aa57461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-90a2de56-5c27-495c-ba45-27600aa57461 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:55.964087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:55.965046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:55.966225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 326/648] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:55.966916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2de56-5c27-495c-ba45-27600aa57461 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:55.996721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778608f5-11a0-4a41-a3f1-6ec10c527d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:55.997938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778608f5-11a0-4a41-a3f1-6ec10c527d19 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:55.998429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778608f5-11a0-4a41-a3f1-6ec10c527d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:55.998930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778608f5-11a0-4a41-a3f1-6ec10c527d19 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:56.007247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778608f5-11a0-4a41-a3f1-6ec10c527d19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:56.008954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778608f5-11a0-4a41-a3f1-6ec10c527d19 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-778608f5-11a0-4a41-a3f1-6ec10c527d19 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:56.024314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:56.025325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:56.026353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:56.026353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:56.026353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:56.026353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:56.026353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:56.026353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:56.026353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:56.026353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:56.026353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 20:17:56.026353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:56.028948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 323/649] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:56.030101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778608f5-11a0-4a41-a3f1-6ec10c527d19 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:56.089077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2de56-5c27-495c-ba45-27600aa57461 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:56.127732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d0829-f91c-4447-b6ea-d7132804b403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:56.128768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0829-f91c-4447-b6ea-d7132804b403 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:56.129302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0829-f91c-4447-b6ea-d7132804b403 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:56.129786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0829-f91c-4447-b6ea-d7132804b403 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:56.130715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d0829-f91c-4447-b6ea-d7132804b403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:56.131770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d0829-f91c-4447-b6ea-d7132804b403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:56.133945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d0829-f91c-4447-b6ea-d7132804b403 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:56.142578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778608f5-11a0-4a41-a3f1-6ec10c527d19 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:56.152342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 327/650] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:56.153690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d0829-f91c-4447-b6ea-d7132804b403 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:56.183752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfe8f9-5cee-4ca5-b70a-900d8ace07d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:56.184351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfe8f9-5cee-4ca5-b70a-900d8ace07d8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:56.184636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfe8f9-5cee-4ca5-b70a-900d8ace07d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:56.184914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfe8f9-5cee-4ca5-b70a-900d8ace07d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:56.185863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfe8f9-5cee-4ca5-b70a-900d8ace07d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:56.186079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfe8f9-5cee-4ca5-b70a-900d8ace07d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:56.187614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfe8f9-5cee-4ca5-b70a-900d8ace07d8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:56.197935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 324/651] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:56.198694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfe8f9-5cee-4ca5-b70a-900d8ace07d8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:56.273461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d0829-f91c-4447-b6ea-d7132804b403 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:56.305728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfe8f9-5cee-4ca5-b70a-900d8ace07d8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:56.308527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce59ec-0cf4-41e0-a2a1-2d24733b74b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:56.309508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce59ec-0cf4-41e0-a2a1-2d24733b74b7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:56.310001 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce59ec-0cf4-41e0-a2a1-2d24733b74b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:56.310477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce59ec-0cf4-41e0-a2a1-2d24733b74b7 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:56.311543 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce59ec-0cf4-41e0-a2a1-2d24733b74b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:56.312053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce59ec-0cf4-41e0-a2a1-2d24733b74b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:56.313746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce59ec-0cf4-41e0-a2a1-2d24733b74b7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:56.333479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 328/652] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 12 20:17:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:56.334704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce59ec-0cf4-41e0-a2a1-2d24733b74b7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:56.347230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cf4d-dde5-4501-b231-f2aa2b19c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:56.348036 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cf4d-dde5-4501-b231-f2aa2b19c9cf None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:56.348388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cf4d-dde5-4501-b231-f2aa2b19c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:56.348836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cf4d-dde5-4501-b231-f2aa2b19c9cf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:56.357012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cf4d-dde5-4501-b231-f2aa2b19c9cf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:56.358548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cf4d-dde5-4501-b231-f2aa2b19c9cf None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8497cf4d-dde5-4501-b231-f2aa2b19c9cf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:56.374610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:56.375636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:56.376572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:56.376572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:56.376572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:56.376572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:56.376572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:56.376572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:56.376572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:56.376572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:56.376572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 20:17:56.376572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:56.382028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 325/653] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:56.383276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cf4d-dde5-4501-b231-f2aa2b19c9cf None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:56.449493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce59ec-0cf4-41e0-a2a1-2d24733b74b7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:56.484254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e1dc0-0626-4376-85cc-982e2908cf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:56.485070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1dc0-0626-4376-85cc-982e2908cf3b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:56.485386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1dc0-0626-4376-85cc-982e2908cf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:56.485666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1dc0-0626-4376-85cc-982e2908cf3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:56.497850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e1dc0-0626-4376-85cc-982e2908cf3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:56.498506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cf4d-dde5-4501-b231-f2aa2b19c9cf None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:56.499334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e1dc0-0626-4376-85cc-982e2908cf3b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-8c6e1dc0-0626-4376-85cc-982e2908cf3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:56.522989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:56.524355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:56.525545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:56.525545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:56.525545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:56.525545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:56.525545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 329/654] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:56.526172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e1dc0-0626-4376-85cc-982e2908cf3b None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:56.544264 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f207b0-a705-4866-8118-1b85ac4f80fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:56.545201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f207b0-a705-4866-8118-1b85ac4f80fc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:56.545651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f207b0-a705-4866-8118-1b85ac4f80fc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:56.546371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f207b0-a705-4866-8118-1b85ac4f80fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:56.618342 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f207b0-a705-4866-8118-1b85ac4f80fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:56.620357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f207b0-a705-4866-8118-1b85ac4f80fc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:56.636642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e1dc0-0626-4376-85cc-982e2908cf3b None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:56.672019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776682de-8f92-42af-8afb-2575e0c586c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:56.672893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776682de-8f92-42af-8afb-2575e0c586c4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:56.673303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776682de-8f92-42af-8afb-2575e0c586c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:56.673682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776682de-8f92-42af-8afb-2575e0c586c4 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:56.674650 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776682de-8f92-42af-8afb-2575e0c586c4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:56.675283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776682de-8f92-42af-8afb-2575e0c586c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:56.676665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776682de-8f92-42af-8afb-2575e0c586c4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:56.700205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 330/655] 10.222.0.59 () {56 vars in 1137 bytes} [Thu May 12 20:17:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:56.700205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776682de-8f92-42af-8afb-2575e0c586c4 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:56.727887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 326/656] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:56.729152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f207b0-a705-4866-8118-1b85ac4f80fc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:56.808326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776682de-8f92-42af-8afb-2575e0c586c4 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:56.832658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f207b0-a705-4866-8118-1b85ac4f80fc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:56.844151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03881bdf-203d-49ac-b75c-2e2ae0278901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:56.844825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03881bdf-203d-49ac-b75c-2e2ae0278901 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:56.845112 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03881bdf-203d-49ac-b75c-2e2ae0278901 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:56.845438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03881bdf-203d-49ac-b75c-2e2ae0278901 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:56.846179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03881bdf-203d-49ac-b75c-2e2ae0278901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:56.846622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03881bdf-203d-49ac-b75c-2e2ae0278901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:56.847845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03881bdf-203d-49ac-b75c-2e2ae0278901 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:56.862663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 331/657] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:56.863517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03881bdf-203d-49ac-b75c-2e2ae0278901 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:56.878668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed163c68-c97d-4e00-a0ed-31ef5f97e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:56.879714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed163c68-c97d-4e00-a0ed-31ef5f97e27d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:56.880008 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed163c68-c97d-4e00-a0ed-31ef5f97e27d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:56.880445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed163c68-c97d-4e00-a0ed-31ef5f97e27d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:56.963353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed163c68-c97d-4e00-a0ed-31ef5f97e27d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:56.964718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed163c68-c97d-4e00-a0ed-31ef5f97e27d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:56.978308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03881bdf-203d-49ac-b75c-2e2ae0278901 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:57.014045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681de05-8eb0-4569-acef-a1b9f1c34019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:57.014848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681de05-8eb0-4569-acef-a1b9f1c34019 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:57.015135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681de05-8eb0-4569-acef-a1b9f1c34019 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:57.015411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681de05-8eb0-4569-acef-a1b9f1c34019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:57.026198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681de05-8eb0-4569-acef-a1b9f1c34019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:57.027739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681de05-8eb0-4569-acef-a1b9f1c34019 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-7681de05-8eb0-4569-acef-a1b9f1c34019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:57.047056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:57.047984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:57.048881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:57.048881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:57.048881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:57.048881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:57.049652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 332/658] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:57.050454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681de05-8eb0-4569-acef-a1b9f1c34019 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:57.069619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 327/659] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:57.070480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed163c68-c97d-4e00-a0ed-31ef5f97e27d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:57.154672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681de05-8eb0-4569-acef-a1b9f1c34019 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:57.168178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed163c68-c97d-4e00-a0ed-31ef5f97e27d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:57.189445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a773-c32a-41c2-b71e-dcd69f4e518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:57.190257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a773-c32a-41c2-b71e-dcd69f4e518e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:57.190542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a773-c32a-41c2-b71e-dcd69f4e518e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:57.190823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a773-c32a-41c2-b71e-dcd69f4e518e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:57.199574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3a773-c32a-41c2-b71e-dcd69f4e518e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:57.201019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3a773-c32a-41c2-b71e-dcd69f4e518e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:57.203643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83786eee-4019-40e0-93f1-801069dff597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:57.204326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83786eee-4019-40e0-93f1-801069dff597 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:57.204607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83786eee-4019-40e0-93f1-801069dff597 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:57.204884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83786eee-4019-40e0-93f1-801069dff597 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:57.205648 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83786eee-4019-40e0-93f1-801069dff597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:57.205957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83786eee-4019-40e0-93f1-801069dff597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:57.207320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83786eee-4019-40e0-93f1-801069dff597 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-45a3a773-c32a-41c2-b71e-dcd69f4e518e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:57.215846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:57.218113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:57.220374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:57.220374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:57.220374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:57.220374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:57.220374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:57.220374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:57.220374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:57.220374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:57.220374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 20:17:57.220374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:57.221669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 333/661] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:57.228396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a773-c32a-41c2-b71e-dcd69f4e518e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:57.228684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 328/661] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:57.228684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83786eee-4019-40e0-93f1-801069dff597 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:57.366660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a773-c32a-41c2-b71e-dcd69f4e518e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:57.428808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8134-f0b9-4839-b7d7-0a1b11e788a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:57.430275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8134-f0b9-4839-b7d7-0a1b11e788a0 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:57.430787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8134-f0b9-4839-b7d7-0a1b11e788a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:57.431291 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8134-f0b9-4839-b7d7-0a1b11e788a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:57.452215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b8134-f0b9-4839-b7d7-0a1b11e788a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:57.454039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b8134-f0b9-4839-b7d7-0a1b11e788a0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-f99b8134-f0b9-4839-b7d7-0a1b11e788a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:57.472719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:57.475392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:57.477703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:57.477703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:57.477703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:57.477703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:57.477703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 334/662] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:57.477703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8134-f0b9-4839-b7d7-0a1b11e788a0 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:57.508198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83786eee-4019-40e0-93f1-801069dff597 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:57.545233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60e9cf-2016-4d3c-8a3e-2115e2b97c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:57.546381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e9cf-2016-4d3c-8a3e-2115e2b97c0f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:57.546920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e9cf-2016-4d3c-8a3e-2115e2b97c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:57.547203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e9cf-2016-4d3c-8a3e-2115e2b97c0f None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:57.548067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60e9cf-2016-4d3c-8a3e-2115e2b97c0f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:57.548378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60e9cf-2016-4d3c-8a3e-2115e2b97c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:57.550057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60e9cf-2016-4d3c-8a3e-2115e2b97c0f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:57.577437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 329/663] 10.222.0.59 () {56 vars in 1139 bytes} [Thu May 12 20:17:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:57.578355 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60e9cf-2016-4d3c-8a3e-2115e2b97c0f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:57.600492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8134-f0b9-4839-b7d7-0a1b11e788a0 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:57.636087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a41064-2b60-491b-a3b9-77b416f3519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:57.636888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a41064-2b60-491b-a3b9-77b416f3519a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:57.637177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a41064-2b60-491b-a3b9-77b416f3519a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:57.637498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a41064-2b60-491b-a3b9-77b416f3519a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:57.644569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a41064-2b60-491b-a3b9-77b416f3519a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:57.646050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a41064-2b60-491b-a3b9-77b416f3519a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-08a41064-2b60-491b-a3b9-77b416f3519a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:57.661671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:57.664628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:57.666795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:57.666795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:57.666795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:57.666795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:57.666795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:57.666795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:57.666795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:57.666795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:57.673326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 335/664] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:57.673326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a41064-2b60-491b-a3b9-77b416f3519a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:57.724853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60e9cf-2016-4d3c-8a3e-2115e2b97c0f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:57.762508 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3847b-50ac-47f1-97b0-924ba08d7f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:57.763183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3847b-50ac-47f1-97b0-924ba08d7f0d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:57.763469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3847b-50ac-47f1-97b0-924ba08d7f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:57.763750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3847b-50ac-47f1-97b0-924ba08d7f0d None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:57.764485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3847b-50ac-47f1-97b0-924ba08d7f0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:57.764794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3847b-50ac-47f1-97b0-924ba08d7f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:57.766193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3847b-50ac-47f1-97b0-924ba08d7f0d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:57.782473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 330/665] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:57.782473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3847b-50ac-47f1-97b0-924ba08d7f0d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:57.802005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a41064-2b60-491b-a3b9-77b416f3519a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:57.839042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020c77-ec39-43b6-b305-3cc8d065fb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:57.839700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020c77-ec39-43b6-b305-3cc8d065fb65 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:57.839983 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020c77-ec39-43b6-b305-3cc8d065fb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:57.840273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020c77-ec39-43b6-b305-3cc8d065fb65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:57.904286 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3847b-50ac-47f1-97b0-924ba08d7f0d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:57.922174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020c77-ec39-43b6-b305-3cc8d065fb65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:57.923698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020c77-ec39-43b6-b305-3cc8d065fb65 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:57.943920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e248d-686d-454f-afd7-82c7241fe327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:57.944746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e248d-686d-454f-afd7-82c7241fe327 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:57.945036 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e248d-686d-454f-afd7-82c7241fe327 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:57.945340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e248d-686d-454f-afd7-82c7241fe327 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:57.946226 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e248d-686d-454f-afd7-82c7241fe327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:57.946539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e248d-686d-454f-afd7-82c7241fe327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:57.948082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e248d-686d-454f-afd7-82c7241fe327 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:57.960695 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 331/666] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:57.962136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22247f-9cd4-4e40-8e38-717648e2e23d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:57.962430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22247f-9cd4-4e40-8e38-717648e2e23d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:57.962761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22247f-9cd4-4e40-8e38-717648e2e23d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:57.968439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 332/667] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:57.968439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22247f-9cd4-4e40-8e38-717648e2e23d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:58.030941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 336/668] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:17:58.031717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020c77-ec39-43b6-b305-3cc8d065fb65 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:58.074062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22247f-9cd4-4e40-8e38-717648e2e23d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:58.107120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a861ed-fd91-413b-b9c5-6dd148ab4390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:58.107907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a861ed-fd91-413b-b9c5-6dd148ab4390 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.108192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a861ed-fd91-413b-b9c5-6dd148ab4390 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.108640 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a861ed-fd91-413b-b9c5-6dd148ab4390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.115408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a861ed-fd91-413b-b9c5-6dd148ab4390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:58.117195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a861ed-fd91-413b-b9c5-6dd148ab4390 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:58.129600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020c77-ec39-43b6-b305-3cc8d065fb65 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-62a861ed-fd91-413b-b9c5-6dd148ab4390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:58.132881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:58.133990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:58.134868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:58.134868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:58.134868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:58.134868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:58.134868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:58.134868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:58.134868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:58.134868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:58.134868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 333/669] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:58.136027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90206-86c8-4618-988c-314a7f911e62 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.136313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90206-86c8-4618-988c-314a7f911e62 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.136587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90206-86c8-4618-988c-314a7f911e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.154754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e0a90206-86c8-4618-988c-314a7f911e62 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:58.156123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e0a90206-86c8-4618-988c-314a7f911e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:58.166357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693254eb-9f71-4add-adb9-16024e22c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:58.167028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693254eb-9f71-4add-adb9-16024e22c858 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.167316 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693254eb-9f71-4add-adb9-16024e22c858 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.167597 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693254eb-9f71-4add-adb9-16024e22c858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.168434 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693254eb-9f71-4add-adb9-16024e22c858 None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=1f8ec4765e05461a98b3c9eb1d3ced5d) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:58.168749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693254eb-9f71-4add-adb9-16024e22c858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:58.170209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693254eb-9f71-4add-adb9-16024e22c858 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:58.178272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 337/670] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:58 2022] GET /identity/v3/role_assignments?user.id=1f8ec4765e05461a98b3c9eb1d3ced5d&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:58.179764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d128f-cfe1-4354-a8ef-f0c2e2c260c2 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.180060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d128f-cfe1-4354-a8ef-f0c2e2c260c2 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.180342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d128f-cfe1-4354-a8ef-f0c2e2c260c2 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.181623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 338/671] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:17:58.182358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d128f-cfe1-4354-a8ef-f0c2e2c260c2 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:58.249965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 334/672] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:58.251297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a90206-86c8-4618-988c-314a7f911e62 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:58.320174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d128f-cfe1-4354-a8ef-f0c2e2c260c2 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:58.363415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a90206-86c8-4618-988c-314a7f911e62 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:58.368838 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650a8f3-5e36-4c2f-b8f0-5c7b8fb5d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:58.370239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650a8f3-5e36-4c2f-b8f0-5c7b8fb5d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.370673 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650a8f3-5e36-4c2f-b8f0-5c7b8fb5d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.371124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650a8f3-5e36-4c2f-b8f0-5c7b8fb5d7e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.388388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650a8f3-5e36-4c2f-b8f0-5c7b8fb5d7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:58.389886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650a8f3-5e36-4c2f-b8f0-5c7b8fb5d7e3 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:58.409608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f392b5-6556-4ba2-af50-9a44f408d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:58.410282 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f392b5-6556-4ba2-af50-9a44f408d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.410573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f392b5-6556-4ba2-af50-9a44f408d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.410856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f392b5-6556-4ba2-af50-9a44f408d3b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-6650a8f3-5e36-4c2f-b8f0-5c7b8fb5d7e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:58.411311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:58.412154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:58.413083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:58.413083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:58.413083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:58.413083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:58.413336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f392b5-6556-4ba2-af50-9a44f408d3b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:58.413336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f392b5-6556-4ba2-af50-9a44f408d3b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:58.413869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f392b5-6556-4ba2-af50-9a44f408d3b6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:58.415566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 339/673] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:58.416199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6419f-98ac-4511-b8ea-35e98b137d3b None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.416485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6419f-98ac-4511-b8ea-35e98b137d3b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.416767 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6419f-98ac-4511-b8ea-35e98b137d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.426678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 335/674] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:58.427436 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f392b5-6556-4ba2-af50-9a44f408d3b6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:58.436512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-12c6419f-98ac-4511-b8ea-35e98b137d3b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:17:58.438052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-12c6419f-98ac-4511-b8ea-35e98b137d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:17:58.510648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 340/675] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:17:58.512229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6419f-98ac-4511-b8ea-35e98b137d3b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:58.540994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f392b5-6556-4ba2-af50-9a44f408d3b6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:58.587200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c90742-6c52-4b08-ac90-4958a83244d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:58.588548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c90742-6c52-4b08-ac90-4958a83244d6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.589050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c90742-6c52-4b08-ac90-4958a83244d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.589507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c90742-6c52-4b08-ac90-4958a83244d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.604275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c90742-6c52-4b08-ac90-4958a83244d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d3c90742-6c52-4b08-ac90-4958a83244d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:58.614304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:58.615274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:17:58.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:17:58.623524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 336/676] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:17:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:58.623524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c90742-6c52-4b08-ac90-4958a83244d6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:58.640633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6419f-98ac-4511-b8ea-35e98b137d3b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:58.673880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebff159-8f24-48d7-a86a-16205854dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:58.674553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebff159-8f24-48d7-a86a-16205854dc31 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.674840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebff159-8f24-48d7-a86a-16205854dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.675120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebff159-8f24-48d7-a86a-16205854dc31 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.675852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebff159-8f24-48d7-a86a-16205854dc31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:58.676162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebff159-8f24-48d7-a86a-16205854dc31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:58.677625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebff159-8f24-48d7-a86a-16205854dc31 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:58.694901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 341/677] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:58.695441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebff159-8f24-48d7-a86a-16205854dc31 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:58.716872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c90742-6c52-4b08-ac90-4958a83244d6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:58.750339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e3cf6-a516-46f5-8fae-2245bf82a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:58.751164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e3cf6-a516-46f5-8fae-2245bf82a04f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.751281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e3cf6-a516-46f5-8fae-2245bf82a04f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.751544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e3cf6-a516-46f5-8fae-2245bf82a04f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.752378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e3cf6-a516-46f5-8fae-2245bf82a04f None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=a32db19a943345b6ba1c91e79739835f) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:58.752692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e3cf6-a516-46f5-8fae-2245bf82a04f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:58.754135 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e3cf6-a516-46f5-8fae-2245bf82a04f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:58.766715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 337/678] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:58 2022] GET /identity/v3/role_assignments?user.id=a32db19a943345b6ba1c91e79739835f&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:58.766715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e3cf6-a516-46f5-8fae-2245bf82a04f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:58.805544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebff159-8f24-48d7-a86a-16205854dc31 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:58.844431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3d447-14c6-457d-a26a-c7eb37bcfe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:58.845627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3d447-14c6-457d-a26a-c7eb37bcfe8f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.846103 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3d447-14c6-457d-a26a-c7eb37bcfe8f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.846630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3d447-14c6-457d-a26a-c7eb37bcfe8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.859382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3d447-14c6-457d-a26a-c7eb37bcfe8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-59f3d447-14c6-457d-a26a-c7eb37bcfe8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:17:58.868489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:58.869787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:17:58.870626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:58.871261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 342/679] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:17:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:58.877365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3d447-14c6-457d-a26a-c7eb37bcfe8f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:58.896411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e3cf6-a516-46f5-8fae-2245bf82a04f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:58.943168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905635f5-73e3-4e85-a512-8d59588e2ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:58.944833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905635f5-73e3-4e85-a512-8d59588e2ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:58.945563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905635f5-73e3-4e85-a512-8d59588e2ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:58.946176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905635f5-73e3-4e85-a512-8d59588e2ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:58.947422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905635f5-73e3-4e85-a512-8d59588e2ab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:58.948407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905635f5-73e3-4e85-a512-8d59588e2ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:58.950585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905635f5-73e3-4e85-a512-8d59588e2ab6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:58.967112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 338/680] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:17:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:58.969755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905635f5-73e3-4e85-a512-8d59588e2ab6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:59.010689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3d447-14c6-457d-a26a-c7eb37bcfe8f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:59.065157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee324b01-c0ac-4fba-b850-9145765b4b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:59.066727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee324b01-c0ac-4fba-b850-9145765b4b22 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:59.067243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee324b01-c0ac-4fba-b850-9145765b4b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:59.067751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee324b01-c0ac-4fba-b850-9145765b4b22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:59.081733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee324b01-c0ac-4fba-b850-9145765b4b22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:59.083520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee324b01-c0ac-4fba-b850-9145765b4b22 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-ee324b01-c0ac-4fba-b850-9145765b4b22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:17:59.099248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:59.101169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:59.102105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:17:59.102105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:17:59.102105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:17:59.102105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:17:59.102105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:17:59.102105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:17:59.102105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:17:59.102105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:59.104311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 343/681] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:17:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:59.105358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee324b01-c0ac-4fba-b850-9145765b4b22 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:59.112005 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905635f5-73e3-4e85-a512-8d59588e2ab6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:59.155565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326e70-99e7-4e86-bced-1ebbfde3b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:59.156509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326e70-99e7-4e86-bced-1ebbfde3b525 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:59.156817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326e70-99e7-4e86-bced-1ebbfde3b525 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:59.157097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326e70-99e7-4e86-bced-1ebbfde3b525 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:59.158110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37326e70-99e7-4e86-bced-1ebbfde3b525 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:59.158411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37326e70-99e7-4e86-bced-1ebbfde3b525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:59.159773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37326e70-99e7-4e86-bced-1ebbfde3b525 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:59.173363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 339/682] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:17:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:59.174516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326e70-99e7-4e86-bced-1ebbfde3b525 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:59.211531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee324b01-c0ac-4fba-b850-9145765b4b22 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:59.253055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33c716-e515-402c-8adc-ebefd0ac3726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:59.253905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33c716-e515-402c-8adc-ebefd0ac3726 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:59.254188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33c716-e515-402c-8adc-ebefd0ac3726 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:59.254617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33c716-e515-402c-8adc-ebefd0ac3726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:59.268511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33c716-e515-402c-8adc-ebefd0ac3726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:59.270624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33c716-e515-402c-8adc-ebefd0ac3726 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:59.291871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326e70-99e7-4e86-bced-1ebbfde3b525 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-fe33c716-e515-402c-8adc-ebefd0ac3726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:59.293593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:59.294483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:59.295396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:59.295396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:59.295396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:59.295396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:59.297421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 344/683] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:59.298445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33c716-e515-402c-8adc-ebefd0ac3726 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:59.341128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c38334-f111-4e7f-87bb-b0c1dcb819ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:59.341899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c38334-f111-4e7f-87bb-b0c1dcb819ba None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:59.342187 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c38334-f111-4e7f-87bb-b0c1dcb819ba None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:59.342467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c38334-f111-4e7f-87bb-b0c1dcb819ba None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:59.343267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c38334-f111-4e7f-87bb-b0c1dcb819ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:59.343579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c38334-f111-4e7f-87bb-b0c1dcb819ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:59.345073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c38334-f111-4e7f-87bb-b0c1dcb819ba None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:59.362910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 340/684] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:59.364037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c38334-f111-4e7f-87bb-b0c1dcb819ba None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:59.425926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33c716-e515-402c-8adc-ebefd0ac3726 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:59.467346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c38334-f111-4e7f-87bb-b0c1dcb819ba None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:59.472077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f02c62-da4f-4170-9204-32a1c1c8658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:59.472915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f02c62-da4f-4170-9204-32a1c1c8658a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:59.473204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f02c62-da4f-4170-9204-32a1c1c8658a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:59.473686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f02c62-da4f-4170-9204-32a1c1c8658a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:59.485874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f02c62-da4f-4170-9204-32a1c1c8658a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:59.487666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f02c62-da4f-4170-9204-32a1c1c8658a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-37f02c62-da4f-4170-9204-32a1c1c8658a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:17:59.507250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:59.508215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:59.509113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:17:59.509113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:17:59.509113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:17:59.509113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:59.513036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 345/685] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:59.513946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f02c62-da4f-4170-9204-32a1c1c8658a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:59.520523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b77fd8-164f-419a-a510-4bdfbe393f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:59.521546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b77fd8-164f-419a-a510-4bdfbe393f34 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:59.522770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b77fd8-164f-419a-a510-4bdfbe393f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:59.523303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b77fd8-164f-419a-a510-4bdfbe393f34 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:59.524789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b77fd8-164f-419a-a510-4bdfbe393f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:59.525369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b77fd8-164f-419a-a510-4bdfbe393f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:59.527681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b77fd8-164f-419a-a510-4bdfbe393f34 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:59.543477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 341/686] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:59.545037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b77fd8-164f-419a-a510-4bdfbe393f34 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:59.621303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f02c62-da4f-4170-9204-32a1c1c8658a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:59.656551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac81010-83cb-4401-92e3-c822e2d887f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:59.657224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81010-83cb-4401-92e3-c822e2d887f3 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:59.657568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81010-83cb-4401-92e3-c822e2d887f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:59.657913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac81010-83cb-4401-92e3-c822e2d887f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:59.658757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac81010-83cb-4401-92e3-c822e2d887f3 None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=4379d3e8b38645978efb08ea6f560fc0) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:59.659123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac81010-83cb-4401-92e3-c822e2d887f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:59.660557 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac81010-83cb-4401-92e3-c822e2d887f3 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:59.667069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 346/687] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:17:59 2022] GET /identity/v3/role_assignments?user.id=4379d3e8b38645978efb08ea6f560fc0&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:59.667886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac81010-83cb-4401-92e3-c822e2d887f3 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:59.680995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b77fd8-164f-419a-a510-4bdfbe393f34 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:59.752429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926f69-5f1f-45d3-9ddc-ca0df1422b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:59.753134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926f69-5f1f-45d3-9ddc-ca0df1422b86 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:59.753453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926f69-5f1f-45d3-9ddc-ca0df1422b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:59.753735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926f69-5f1f-45d3-9ddc-ca0df1422b86 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:59.754501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e926f69-5f1f-45d3-9ddc-ca0df1422b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:17:59.754812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e926f69-5f1f-45d3-9ddc-ca0df1422b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:59.758078 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e926f69-5f1f-45d3-9ddc-ca0df1422b86 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:59.783243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 342/688] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:17:59.789561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926f69-5f1f-45d3-9ddc-ca0df1422b86 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:17:59.888959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac81010-83cb-4401-92e3-c822e2d887f3 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:59.945046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108466f-6557-486b-90dc-08934dfc90d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:17:59.946085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108466f-6557-486b-90dc-08934dfc90d0 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:17:59.946383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108466f-6557-486b-90dc-08934dfc90d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:17:59.946668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108466f-6557-486b-90dc-08934dfc90d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:17:59.958105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108466f-6557-486b-90dc-08934dfc90d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:17:59.960287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108466f-6557-486b-90dc-08934dfc90d0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:17:59.973163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926f69-5f1f-45d3-9ddc-ca0df1422b86 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-9108466f-6557-486b-90dc-08934dfc90d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:17:59.979716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:17:59.980754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:17:59.982022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 347/689] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 12 20:17:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:17:59.988052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108466f-6557-486b-90dc-08934dfc90d0 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:00.029900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe845cb-5d5e-4cce-b424-6f7b3d229b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:00.030721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe845cb-5d5e-4cce-b424-6f7b3d229b4f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:00.031004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe845cb-5d5e-4cce-b424-6f7b3d229b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:00.031278 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe845cb-5d5e-4cce-b424-6f7b3d229b4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:00.043572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe845cb-5d5e-4cce-b424-6f7b3d229b4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:00.045445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe845cb-5d5e-4cce-b424-6f7b3d229b4f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-fbe845cb-5d5e-4cce-b424-6f7b3d229b4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:00.061900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:00.062925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:00.063857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 343/690] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:17:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:00.069056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe845cb-5d5e-4cce-b424-6f7b3d229b4f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:00.121154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108466f-6557-486b-90dc-08934dfc90d0 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:00.182082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d92e0e-e705-4b5f-8e7e-583ff8d40925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:00.182690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92e0e-e705-4b5f-8e7e-583ff8d40925 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:00.182970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92e0e-e705-4b5f-8e7e-583ff8d40925 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:00.183248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92e0e-e705-4b5f-8e7e-583ff8d40925 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:00.184098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d92e0e-e705-4b5f-8e7e-583ff8d40925 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:00.184406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d92e0e-e705-4b5f-8e7e-583ff8d40925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:00.185929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d92e0e-e705-4b5f-8e7e-583ff8d40925 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:00.221518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe845cb-5d5e-4cce-b424-6f7b3d229b4f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:00.233624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 348/691] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 12 20:17:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:00.237665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d92e0e-e705-4b5f-8e7e-583ff8d40925 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:00.296125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b3e19-6e2d-40be-9936-6ccc92dc34df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:00.296823 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b3e19-6e2d-40be-9936-6ccc92dc34df None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:00.297104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b3e19-6e2d-40be-9936-6ccc92dc34df None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:00.297413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b3e19-6e2d-40be-9936-6ccc92dc34df None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:00.298270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b3e19-6e2d-40be-9936-6ccc92dc34df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:00.298582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b3e19-6e2d-40be-9936-6ccc92dc34df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:00.300019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b3e19-6e2d-40be-9936-6ccc92dc34df None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:00.340384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 344/692] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 12 20:18:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:00.344602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b3e19-6e2d-40be-9936-6ccc92dc34df None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:00.409670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d92e0e-e705-4b5f-8e7e-583ff8d40925 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:00.448230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1464a8-f9b4-493a-8111-3854b76ca4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:00.448821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1464a8-f9b4-493a-8111-3854b76ca4cb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:00.449095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1464a8-f9b4-493a-8111-3854b76ca4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:00.449401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1464a8-f9b4-493a-8111-3854b76ca4cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:00.519634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1464a8-f9b4-493a-8111-3854b76ca4cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:00.521094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1464a8-f9b4-493a-8111-3854b76ca4cb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:00.539437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b3e19-6e2d-40be-9936-6ccc92dc34df None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:00.609157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38288017-6e95-49ff-80f6-fd95fe4ba409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:00.609826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38288017-6e95-49ff-80f6-fd95fe4ba409 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:00.610116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38288017-6e95-49ff-80f6-fd95fe4ba409 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:00.611001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38288017-6e95-49ff-80f6-fd95fe4ba409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:00.627060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 349/693] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 20:18:00.628428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b9e0-5587-4843-bb50-99f206184bff None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:00.628715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b9e0-5587-4843-bb50-99f206184bff None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:00.628994 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10b9e0-5587-4843-bb50-99f206184bff None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:00.635163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 350/694] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:00.635969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10b9e0-5587-4843-bb50-99f206184bff None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:00.687490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38288017-6e95-49ff-80f6-fd95fe4ba409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:00.688943 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38288017-6e95-49ff-80f6-fd95fe4ba409 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:00.740505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10b9e0-5587-4843-bb50-99f206184bff None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:00.777931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d79a2-2cc9-4f88-abb7-97a6e69700f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:00.778734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d79a2-2cc9-4f88-abb7-97a6e69700f1 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:00.779018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d79a2-2cc9-4f88-abb7-97a6e69700f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:00.779295 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d79a2-2cc9-4f88-abb7-97a6e69700f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:00.790576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d79a2-2cc9-4f88-abb7-97a6e69700f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:00.792125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d79a2-2cc9-4f88-abb7-97a6e69700f1 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:00.794039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 345/695] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:18:00.795459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b608e88-4318-4eef-bfe1-31f0900c6daf None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:00.795748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b608e88-4318-4eef-bfe1-31f0900c6daf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:00.796022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b608e88-4318-4eef-bfe1-31f0900c6daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-226d79a2-2cc9-4f88-abb7-97a6e69700f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:00.811044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:00.813186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:00.815428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:00.815428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:00.815428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:00.815428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:00.816070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0b608e88-4318-4eef-bfe1-31f0900c6daf None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:00.816070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0b608e88-4318-4eef-bfe1-31f0900c6daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:00.821336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 351/696] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:00.821336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d79a2-2cc9-4f88-abb7-97a6e69700f1 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:00.897509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 346/697] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:18:00.898813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b608e88-4318-4eef-bfe1-31f0900c6daf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:00.937302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d79a2-2cc9-4f88-abb7-97a6e69700f1 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:00.969713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7369e-9b52-4b10-9c6b-a8f2b462c069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:00.970271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7369e-9b52-4b10-9c6b-a8f2b462c069 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:00.970559 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7369e-9b52-4b10-9c6b-a8f2b462c069 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:00.970833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7369e-9b52-4b10-9c6b-a8f2b462c069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:00.983263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7369e-9b52-4b10-9c6b-a8f2b462c069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:00.984905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7369e-9b52-4b10-9c6b-a8f2b462c069 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-b1b7369e-9b52-4b10-9c6b-a8f2b462c069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:01.003561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:01.004528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:01.006138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:01.006138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:01.006138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:01.006138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:01.006138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 352/698] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:01.006138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7369e-9b52-4b10-9c6b-a8f2b462c069 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:01.033424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b608e88-4318-4eef-bfe1-31f0900c6daf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:01.071073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff70bef-858f-4fd1-ad20-b5eeef3d9dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:01.072106 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70bef-858f-4fd1-ad20-b5eeef3d9dfc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:01.072612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70bef-858f-4fd1-ad20-b5eeef3d9dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:01.073093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70bef-858f-4fd1-ad20-b5eeef3d9dfc None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:01.074072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff70bef-858f-4fd1-ad20-b5eeef3d9dfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:01.074592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff70bef-858f-4fd1-ad20-b5eeef3d9dfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:01.076155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff70bef-858f-4fd1-ad20-b5eeef3d9dfc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:01.088891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 347/699] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:01.090146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff70bef-858f-4fd1-ad20-b5eeef3d9dfc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:01.115230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7369e-9b52-4b10-9c6b-a8f2b462c069 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:01.151703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26527669-b9b1-4e60-a3c6-747720939d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:01.152629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26527669-b9b1-4e60-a3c6-747720939d1f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:01.153161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26527669-b9b1-4e60-a3c6-747720939d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:01.153161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26527669-b9b1-4e60-a3c6-747720939d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:01.165998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26527669-b9b1-4e60-a3c6-747720939d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:01.167454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26527669-b9b1-4e60-a3c6-747720939d1f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-26527669-b9b1-4e60-a3c6-747720939d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:01.185214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:01.186217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:01.192250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:01.192250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:01.192250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:01.192250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:01.192250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 353/700] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:01.192250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26527669-b9b1-4e60-a3c6-747720939d1f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:01.212113 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff70bef-858f-4fd1-ad20-b5eeef3d9dfc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:01.253668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59440caf-eddf-4b94-81e8-f6818e786d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:01.254706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59440caf-eddf-4b94-81e8-f6818e786d40 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:01.255206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59440caf-eddf-4b94-81e8-f6818e786d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:01.255686 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59440caf-eddf-4b94-81e8-f6818e786d40 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:01.257266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59440caf-eddf-4b94-81e8-f6818e786d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:01.258004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59440caf-eddf-4b94-81e8-f6818e786d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:01.259640 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59440caf-eddf-4b94-81e8-f6818e786d40 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:01.276214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 348/701] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:01.277660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59440caf-eddf-4b94-81e8-f6818e786d40 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:01.404199 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59440caf-eddf-4b94-81e8-f6818e786d40 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:01.435683 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26527669-b9b1-4e60-a3c6-747720939d1f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:01.441018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399362d-0c49-4de3-8504-2f73e2d4237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:01.442012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399362d-0c49-4de3-8504-2f73e2d4237a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:01.442599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399362d-0c49-4de3-8504-2f73e2d4237a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:01.443094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399362d-0c49-4de3-8504-2f73e2d4237a None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:01.444595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399362d-0c49-4de3-8504-2f73e2d4237a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:01.445094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399362d-0c49-4de3-8504-2f73e2d4237a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:01.446681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399362d-0c49-4de3-8504-2f73e2d4237a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:01.464258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 349/702] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:01.464258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399362d-0c49-4de3-8504-2f73e2d4237a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:01.477676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de2efc-4185-4aa8-9118-90bc4ab21dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:01.478545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de2efc-4185-4aa8-9118-90bc4ab21dae None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:01.478833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de2efc-4185-4aa8-9118-90bc4ab21dae None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:01.479171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de2efc-4185-4aa8-9118-90bc4ab21dae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:01.486180 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de2efc-4185-4aa8-9118-90bc4ab21dae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:01.487632 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de2efc-4185-4aa8-9118-90bc4ab21dae None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-b2de2efc-4185-4aa8-9118-90bc4ab21dae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:01.502386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:01.503383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:01.504318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:01.504318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:01.504318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:01.504318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:01.504318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:01.504318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:01.504318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:01.504318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:01.508889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 354/703] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:01.510375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3c59-a6a6-417b-ac2a-5a5058f2cdcd None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:01.510670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3c59-a6a6-417b-ac2a-5a5058f2cdcd None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:01.510958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3c59-a6a6-417b-ac2a-5a5058f2cdcd None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:01.512442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 355/704] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:01.513054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe3c59-a6a6-417b-ac2a-5a5058f2cdcd None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:01.566915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399362d-0c49-4de3-8504-2f73e2d4237a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:01.600660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475a3c5-0ac6-4053-a616-435aee722b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:01.601501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475a3c5-0ac6-4053-a616-435aee722b69 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:01.601789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475a3c5-0ac6-4053-a616-435aee722b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:01.602066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475a3c5-0ac6-4053-a616-435aee722b69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:01.608786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475a3c5-0ac6-4053-a616-435aee722b69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:01.610266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475a3c5-0ac6-4053-a616-435aee722b69 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:01.618820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe3c59-a6a6-417b-ac2a-5a5058f2cdcd None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5475a3c5-0ac6-4053-a616-435aee722b69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:01.625231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:01.626137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:01.627006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:01.627006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:01.627006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:01.627006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:01.627006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:01.627006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:01.627006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:01.627006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:01.627006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 350/705] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:01.627476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475a3c5-0ac6-4053-a616-435aee722b69 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:01.655660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889b3ac-2ef2-4418-b671-43df3525bb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:01.656333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889b3ac-2ef2-4418-b671-43df3525bb11 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:01.656621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889b3ac-2ef2-4418-b671-43df3525bb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:01.656908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889b3ac-2ef2-4418-b671-43df3525bb11 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:01.657647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889b3ac-2ef2-4418-b671-43df3525bb11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:01.659083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889b3ac-2ef2-4418-b671-43df3525bb11 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:01.727545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475a3c5-0ac6-4053-a616-435aee722b69 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:01.748500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 356/706] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:18:01 2022] POST /identity/v3/users => generated 254 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:01.750056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfac58-296d-4647-b585-2f422987712c None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:01.750610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfac58-296d-4647-b585-2f422987712c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:01.751265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfac58-296d-4647-b585-2f422987712c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:01.767411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df429de-44bd-464a-b448-f9176b456299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:01.767854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df429de-44bd-464a-b448-f9176b456299 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:01.768143 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df429de-44bd-464a-b448-f9176b456299 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:01.768422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df429de-44bd-464a-b448-f9176b456299 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:01.769254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df429de-44bd-464a-b448-f9176b456299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:01.773857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df429de-44bd-464a-b448-f9176b456299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:01.777029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df429de-44bd-464a-b448-f9176b456299 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:01.781906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d4bfac58-296d-4647-b585-2f422987712c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:01.783257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d4bfac58-296d-4647-b585-2f422987712c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:01.794145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 351/707] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:01.795403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df429de-44bd-464a-b448-f9176b456299 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:01.878779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 357/708] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:18:01.880095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfac58-296d-4647-b585-2f422987712c None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:01.962857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df429de-44bd-464a-b448-f9176b456299 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:02.011185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bcbe4-6968-4a38-9fa0-c81cad75a5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:02.011865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bcbe4-6968-4a38-9fa0-c81cad75a5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:02.012154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bcbe4-6968-4a38-9fa0-c81cad75a5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:02.012434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bcbe4-6968-4a38-9fa0-c81cad75a5f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:02.013233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bcbe4-6968-4a38-9fa0-c81cad75a5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:02.014770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bcbe4-6968-4a38-9fa0-c81cad75a5f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:02.015029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bcbe4-6968-4a38-9fa0-c81cad75a5f1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:02.034137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 352/709] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:02.035315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bcbe4-6968-4a38-9fa0-c81cad75a5f1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:02.040021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfac58-296d-4647-b585-2f422987712c None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:02.083679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ff7ff-de50-40d3-ad2e-ad533aa10314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:02.084215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ff7ff-de50-40d3-ad2e-ad533aa10314 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:02.084499 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ff7ff-de50-40d3-ad2e-ad533aa10314 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:02.084774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ff7ff-de50-40d3-ad2e-ad533aa10314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:02.085654 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ff7ff-de50-40d3-ad2e-ad533aa10314 None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=156646eda779439784ddbc7d1fbd5b90) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:02.085965 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ff7ff-de50-40d3-ad2e-ad533aa10314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:02.087406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ff7ff-de50-40d3-ad2e-ad533aa10314 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:02.094225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 358/710] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:01 2022] GET /identity/v3/role_assignments?user.id=156646eda779439784ddbc7d1fbd5b90&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=4ae0665802b946be870ab06274297a1d => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:02.095078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ff7ff-de50-40d3-ad2e-ad533aa10314 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:02.217755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bcbe4-6968-4a38-9fa0-c81cad75a5f1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:02.297261 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07dead-b67f-4c8e-ae0f-c2fa6d5565a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:02.298047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07dead-b67f-4c8e-ae0f-c2fa6d5565a8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:02.298333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07dead-b67f-4c8e-ae0f-c2fa6d5565a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:02.298619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07dead-b67f-4c8e-ae0f-c2fa6d5565a8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:02.299294 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07dead-b67f-4c8e-ae0f-c2fa6d5565a8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:02.300710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07dead-b67f-4c8e-ae0f-c2fa6d5565a8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:02.303375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ff7ff-de50-40d3-ad2e-ad533aa10314 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-be07dead-b67f-4c8e-ae0f-c2fa6d5565a8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:02.330414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:02.331656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:02.332523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 353/711] 10.222.0.59 () {56 vars in 1129 bytes} [Thu May 12 20:18:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:02.338309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07dead-b67f-4c8e-ae0f-c2fa6d5565a8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:02.375610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077289e5-9cc5-48b1-b4b4-51c459888209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:02.376283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077289e5-9cc5-48b1-b4b4-51c459888209 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:02.376562 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077289e5-9cc5-48b1-b4b4-51c459888209 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:02.376833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077289e5-9cc5-48b1-b4b4-51c459888209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:02.377706 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077289e5-9cc5-48b1-b4b4-51c459888209 None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=766497e7e0614adea5769b05f0c1cdcf) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:02.378012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077289e5-9cc5-48b1-b4b4-51c459888209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:02.379448 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077289e5-9cc5-48b1-b4b4-51c459888209 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:02.397153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 359/712] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:02 2022] GET /identity/v3/role_assignments?user.id=766497e7e0614adea5769b05f0c1cdcf&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:02.457694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcea502-cbc1-44e5-a45b-8fdc33fdf26a None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:02.458044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcea502-cbc1-44e5-a45b-8fdc33fdf26a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:02.458268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcea502-cbc1-44e5-a45b-8fdc33fdf26a None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:02.460469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 360/713] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:02.466324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6f993-7ef8-436e-8339-007b32e3e06b None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:02.466641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6f993-7ef8-436e-8339-007b32e3e06b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:02.466893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6f993-7ef8-436e-8339-007b32e3e06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:02.484837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a0e6f993-7ef8-436e-8339-007b32e3e06b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:02.486115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a0e6f993-7ef8-436e-8339-007b32e3e06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:02.517789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07dead-b67f-4c8e-ae0f-c2fa6d5565a8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:02.561052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 361/714] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:18:02.583354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6f993-7ef8-436e-8339-007b32e3e06b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:02.595070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b84f5-ccee-47c0-90b5-75f0ea408045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:02.595750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b84f5-ccee-47c0-90b5-75f0ea408045 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:02.596033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b84f5-ccee-47c0-90b5-75f0ea408045 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:02.596311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b84f5-ccee-47c0-90b5-75f0ea408045 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:02.597031 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b84f5-ccee-47c0-90b5-75f0ea408045 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:02.597359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b84f5-ccee-47c0-90b5-75f0ea408045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:02.598731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b84f5-ccee-47c0-90b5-75f0ea408045 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:02.609382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 354/715] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 12 20:18:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:02.614768 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b84f5-ccee-47c0-90b5-75f0ea408045 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:02.687835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6f993-7ef8-436e-8339-007b32e3e06b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:02.727197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378001f2-8d62-44df-b81d-6b7fbea9da35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:02.728030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378001f2-8d62-44df-b81d-6b7fbea9da35 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:02.728316 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378001f2-8d62-44df-b81d-6b7fbea9da35 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:02.728595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378001f2-8d62-44df-b81d-6b7fbea9da35 None admin] PATH_INFO: `/v3/services/network` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:02.729291 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378001f2-8d62-44df-b81d-6b7fbea9da35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:02.730744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378001f2-8d62-44df-b81d-6b7fbea9da35 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-378001f2-8d62-44df-b81d-6b7fbea9da35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:02.745435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:02.746489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:02.747312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 362/716] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:02 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:02.752702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378001f2-8d62-44df-b81d-6b7fbea9da35 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:02.800984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b84f5-ccee-47c0-90b5-75f0ea408045 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:02.837743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b2fe0-d65f-47b3-815f-67afdc246e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:02.838427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b2fe0-d65f-47b3-815f-67afdc246e17 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:02.838711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b2fe0-d65f-47b3-815f-67afdc246e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:02.838989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b2fe0-d65f-47b3-815f-67afdc246e17 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:02.839710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b2fe0-d65f-47b3-815f-67afdc246e17 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:02.840079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b2fe0-d65f-47b3-815f-67afdc246e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:02.841542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b2fe0-d65f-47b3-815f-67afdc246e17 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:02.847753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 355/717] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 12 20:18:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:02.858320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378001f2-8d62-44df-b81d-6b7fbea9da35 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:02.898451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddebe80-c070-4f89-822b-04063d06f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:02.899136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddebe80-c070-4f89-822b-04063d06f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:02.899421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddebe80-c070-4f89-822b-04063d06f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:02.899759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddebe80-c070-4f89-822b-04063d06f8b4 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:02.900569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddebe80-c070-4f89-822b-04063d06f8b4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:02.900881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddebe80-c070-4f89-822b-04063d06f8b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:02.902324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddebe80-c070-4f89-822b-04063d06f8b4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:02.907947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 363/718] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:02.914005 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b2fe0-d65f-47b3-815f-67afdc246e17 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:03.035959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b2fe0-d65f-47b3-815f-67afdc246e17 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:03.077372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29901610-78dc-498b-9ff1-18ce6ca7ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:03.078066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29901610-78dc-498b-9ff1-18ce6ca7ac03 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:03.078349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29901610-78dc-498b-9ff1-18ce6ca7ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:03.078629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29901610-78dc-498b-9ff1-18ce6ca7ac03 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:03.079354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29901610-78dc-498b-9ff1-18ce6ca7ac03 None admin] RBAC: Adding query filter params (type=network) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:03.079660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29901610-78dc-498b-9ff1-18ce6ca7ac03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:03.081044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29901610-78dc-498b-9ff1-18ce6ca7ac03 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:03.086942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 356/719] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:04.538862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152984d5-de29-4b0e-9f02-5e0dbbe81090 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:04.539417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152984d5-de29-4b0e-9f02-5e0dbbe81090 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:04.539417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152984d5-de29-4b0e-9f02-5e0dbbe81090 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:04.541244 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 364/720] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:04.547394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc76d4-7c31-4f4b-b128-e072b1105a43 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:04.547934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc76d4-7c31-4f4b-b128-e072b1105a43 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:04.547934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc76d4-7c31-4f4b-b128-e072b1105a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:04.570970 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c1bc76d4-7c31-4f4b-b128-e072b1105a43 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:04.572197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c1bc76d4-7c31-4f4b-b128-e072b1105a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:04.667747 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 357/721] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:18:04.714784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152984d5-de29-4b0e-9f02-5e0dbbe81090 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:04.739494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40f90c-e0b3-41f5-9a90-4693f760ebdd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:04.739968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40f90c-e0b3-41f5-9a90-4693f760ebdd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:04.740887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40f90c-e0b3-41f5-9a90-4693f760ebdd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:04.742915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 358/722] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:04.748880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c306-500c-4f43-9226-e31b658f6839 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:04.749172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c306-500c-4f43-9226-e31b658f6839 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:04.749481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c306-500c-4f43-9226-e31b658f6839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:04.777139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e7c0c306-500c-4f43-9226-e31b658f6839 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:04.778358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e7c0c306-500c-4f43-9226-e31b658f6839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:04.867496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152984d5-de29-4b0e-9f02-5e0dbbe81090 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:04.883373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 359/723] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 20:18:04.910898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0c306-500c-4f43-9226-e31b658f6839 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:04.924960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e93209-97a1-46a2-8456-dfca7de106ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:04.926197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e93209-97a1-46a2-8456-dfca7de106ea None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:04.926692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e93209-97a1-46a2-8456-dfca7de106ea None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:04.927181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e93209-97a1-46a2-8456-dfca7de106ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:04.950739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e93209-97a1-46a2-8456-dfca7de106ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-d4e93209-97a1-46a2-8456-dfca7de106ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:04.967143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:04.968125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:18:04.968999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:04.971757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 365/724] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:18:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:04.978162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e93209-97a1-46a2-8456-dfca7de106ea None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:05.020963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0c306-500c-4f43-9226-e31b658f6839 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:05.098651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f00dc-c8cb-4f08-9a07-76e66c8cdb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:05.100072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f00dc-c8cb-4f08-9a07-76e66c8cdb13 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.100771 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f00dc-c8cb-4f08-9a07-76e66c8cdb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:05.101086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f00dc-c8cb-4f08-9a07-76e66c8cdb13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:05.103167 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e93209-97a1-46a2-8456-dfca7de106ea None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:05.134439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f00dc-c8cb-4f08-9a07-76e66c8cdb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-a38f00dc-c8cb-4f08-9a07-76e66c8cdb13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:05.142035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:05.143074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:05.143932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:05.148630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 360/725] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:05.149986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f00dc-c8cb-4f08-9a07-76e66c8cdb13 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:05.155752 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf204-b043-4997-9787-bfe5a53c9fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:05.156433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf204-b043-4997-9787-bfe5a53c9fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.156713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf204-b043-4997-9787-bfe5a53c9fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:05.156985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf204-b043-4997-9787-bfe5a53c9fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:05.157788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf204-b043-4997-9787-bfe5a53c9fa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:05.158093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf204-b043-4997-9787-bfe5a53c9fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:05.159453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf204-b043-4997-9787-bfe5a53c9fa3 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:05.176467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 366/726] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:18:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:05.183664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf204-b043-4997-9787-bfe5a53c9fa3 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:05.291373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f00dc-c8cb-4f08-9a07-76e66c8cdb13 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:05.333578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52084d71-d832-4b39-b3ef-47cd8a472700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:05.334875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52084d71-d832-4b39-b3ef-47cd8a472700 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.335207 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52084d71-d832-4b39-b3ef-47cd8a472700 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:05.335488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52084d71-d832-4b39-b3ef-47cd8a472700 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:05.336270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52084d71-d832-4b39-b3ef-47cd8a472700 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:05.336576 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52084d71-d832-4b39-b3ef-47cd8a472700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:05.338365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52084d71-d832-4b39-b3ef-47cd8a472700 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:05.353834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 361/727] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:05.354024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52084d71-d832-4b39-b3ef-47cd8a472700 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:05.396309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf204-b043-4997-9787-bfe5a53c9fa3 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:05.482009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a53303-fb69-4e66-be82-26ab318f2ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:05.482881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53303-fb69-4e66-be82-26ab318f2ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.483165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53303-fb69-4e66-be82-26ab318f2ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:05.483442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53303-fb69-4e66-be82-26ab318f2ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:05.488936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52084d71-d832-4b39-b3ef-47cd8a472700 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:05.504735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a53303-fb69-4e66-be82-26ab318f2ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:05.506341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a53303-fb69-4e66-be82-26ab318f2ee8 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-75a53303-fb69-4e66-be82-26ab318f2ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:05.532964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:05.534377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:05.535698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:05.535698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:05.535698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:05.535698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:05.536041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06692361-2750-4892-af93-9c8d1c51104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:05.536041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06692361-2750-4892-af93-9c8d1c51104d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.536041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06692361-2750-4892-af93-9c8d1c51104d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:05.536333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06692361-2750-4892-af93-9c8d1c51104d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:05.536477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 367/728] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:05.541318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb30c6-e677-496c-90ef-b6fe29efd54a None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.541318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb30c6-e677-496c-90ef-b6fe29efd54a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:05.541318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb30c6-e677-496c-90ef-b6fe29efd54a None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:05.541318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 368/729] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:05.546509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2a7d-22f0-41d4-b799-60027f3574a0 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.546798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2a7d-22f0-41d4-b799-60027f3574a0 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:05.547080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b2a7d-22f0-41d4-b799-60027f3574a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:05.552842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06692361-2750-4892-af93-9c8d1c51104d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:05.554558 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06692361-2750-4892-af93-9c8d1c51104d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:05.564866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8b9b2a7d-22f0-41d4-b799-60027f3574a0 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:05.566092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8b9b2a7d-22f0-41d4-b799-60027f3574a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-06692361-2750-4892-af93-9c8d1c51104d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:05.573245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:05.575931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:05.578733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:05.578733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:05.578733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:05.578733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:05.579420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 362/730] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:05.585299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06692361-2750-4892-af93-9c8d1c51104d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:05.645398 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 369/731] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:18:05.646303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b2a7d-22f0-41d4-b799-60027f3574a0 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:05.690260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06692361-2750-4892-af93-9c8d1c51104d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:05.727251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811ab50-0511-47fc-b985-f611923a7ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:05.727919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811ab50-0511-47fc-b985-f611923a7ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.728350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811ab50-0511-47fc-b985-f611923a7ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:05.728977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811ab50-0511-47fc-b985-f611923a7ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:05.729751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811ab50-0511-47fc-b985-f611923a7ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:05.730062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811ab50-0511-47fc-b985-f611923a7ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:05.731430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811ab50-0511-47fc-b985-f611923a7ea9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:05.744920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 363/732] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:05.745801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811ab50-0511-47fc-b985-f611923a7ea9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:05.763844 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b2a7d-22f0-41d4-b799-60027f3574a0 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:05.798648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2bb40-97f8-4079-ad78-8a97b10902e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:05.799421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2bb40-97f8-4079-ad78-8a97b10902e9 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.799712 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2bb40-97f8-4079-ad78-8a97b10902e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:05.799992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2bb40-97f8-4079-ad78-8a97b10902e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:05.800721 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2bb40-97f8-4079-ad78-8a97b10902e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:05.801028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2bb40-97f8-4079-ad78-8a97b10902e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:05.802424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2bb40-97f8-4079-ad78-8a97b10902e9 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:05.814513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 370/733] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:05.815498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2bb40-97f8-4079-ad78-8a97b10902e9 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:05.854720 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811ab50-0511-47fc-b985-f611923a7ea9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:05.898824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e26e9-2339-46ca-84c7-87e7435e575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:05.899636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e26e9-2339-46ca-84c7-87e7435e575a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.899919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e26e9-2339-46ca-84c7-87e7435e575a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:05.900196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e26e9-2339-46ca-84c7-87e7435e575a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:05.913400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e26e9-2339-46ca-84c7-87e7435e575a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-364e26e9-2339-46ca-84c7-87e7435e575a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:05.932369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:05.935847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:05.938705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 364/734] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:05.950118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e26e9-2339-46ca-84c7-87e7435e575a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:05.950408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2bb40-97f8-4079-ad78-8a97b10902e9 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:05.998754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bbf2f-8e92-40d7-8802-6859f99d54f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:05.999645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bbf2f-8e92-40d7-8802-6859f99d54f4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:05.999928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bbf2f-8e92-40d7-8802-6859f99d54f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.000204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bbf2f-8e92-40d7-8802-6859f99d54f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.011321 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bbf2f-8e92-40d7-8802-6859f99d54f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:06.012960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bbf2f-8e92-40d7-8802-6859f99d54f4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-521bbf2f-8e92-40d7-8802-6859f99d54f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:06.032772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:06.033882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 371/735] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 12 20:18:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:06.035483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bbf2f-8e92-40d7-8802-6859f99d54f4 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:06.057225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e26e9-2339-46ca-84c7-87e7435e575a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:06.113788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b783eb-892a-4fdb-a767-48eca31306ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:06.114589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b783eb-892a-4fdb-a767-48eca31306ad None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.114881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b783eb-892a-4fdb-a767-48eca31306ad None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.115730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b783eb-892a-4fdb-a767-48eca31306ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.124085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b783eb-892a-4fdb-a767-48eca31306ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:06.125537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b783eb-892a-4fdb-a767-48eca31306ad None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c0b783eb-892a-4fdb-a767-48eca31306ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:06.139901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:06.140830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:06.141811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 365/736] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 12 20:18:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:06.142380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b783eb-892a-4fdb-a767-48eca31306ad None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:06.147489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bbf2f-8e92-40d7-8802-6859f99d54f4 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:06.180664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0b189-9b72-4f64-8372-c22f1de0983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:06.181362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b189-9b72-4f64-8372-c22f1de0983c None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.181646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b189-9b72-4f64-8372-c22f1de0983c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.181921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0b189-9b72-4f64-8372-c22f1de0983c None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.182663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b189-9b72-4f64-8372-c22f1de0983c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:06.182968 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b189-9b72-4f64-8372-c22f1de0983c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:06.184475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0b189-9b72-4f64-8372-c22f1de0983c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:06.192473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 372/737] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:18:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:06.193979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4412ddc-a857-4049-a153-4c0030cbe786 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.194780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4412ddc-a857-4049-a153-4c0030cbe786 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.195073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4412ddc-a857-4049-a153-4c0030cbe786 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.196532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 373/738] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:06.197488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5eeef-ad2e-4d52-a851-acf50773cdd6 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.197828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5eeef-ad2e-4d52-a851-acf50773cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.198053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5eeef-ad2e-4d52-a851-acf50773cdd6 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.199285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 374/739] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:06.200005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5eeef-ad2e-4d52-a851-acf50773cdd6 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:06.243462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b783eb-892a-4fdb-a767-48eca31306ad None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:06.283599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cd554-cc57-43ad-bda7-e560f757792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:06.284286 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cd554-cc57-43ad-bda7-e560f757792e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.284563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cd554-cc57-43ad-bda7-e560f757792e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.284837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cd554-cc57-43ad-bda7-e560f757792e None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.285728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cd554-cc57-43ad-bda7-e560f757792e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:06.286036 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cd554-cc57-43ad-bda7-e560f757792e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:06.287749 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cd554-cc57-43ad-bda7-e560f757792e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:06.303339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5eeef-ad2e-4d52-a851-acf50773cdd6 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:06.306077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 366/740] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 12 20:18:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:06.306904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cd554-cc57-43ad-bda7-e560f757792e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:06.336639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1438a-eb89-48f3-bc07-1729f314c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:06.337349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1438a-eb89-48f3-bc07-1729f314c248 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.337638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1438a-eb89-48f3-bc07-1729f314c248 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.337918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1438a-eb89-48f3-bc07-1729f314c248 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.338820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1438a-eb89-48f3-bc07-1729f314c248 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:06.339103 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1438a-eb89-48f3-bc07-1729f314c248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:06.340554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1438a-eb89-48f3-bc07-1729f314c248 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:06.358366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 375/741] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 12 20:18:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:06.359654 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd36d22-3c8d-40cb-8db9-d5795034ef8c None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.359953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd36d22-3c8d-40cb-8db9-d5795034ef8c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.360237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd36d22-3c8d-40cb-8db9-d5795034ef8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.377584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-bcd36d22-3c8d-40cb-8db9-d5795034ef8c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:06.378794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bcd36d22-3c8d-40cb-8db9-d5795034ef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:06.413716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cd554-cc57-43ad-bda7-e560f757792e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:06.446298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 376/742] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:18:06.447613 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30b9e9-8bcf-465b-b52d-4eb43e7d1f36 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.447908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30b9e9-8bcf-465b-b52d-4eb43e7d1f36 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.448191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30b9e9-8bcf-465b-b52d-4eb43e7d1f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.455325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d05e5-9c2e-42e0-a823-6d421aea636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:06.456131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d05e5-9c2e-42e0-a823-6d421aea636d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.456413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d05e5-9c2e-42e0-a823-6d421aea636d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.456684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d05e5-9c2e-42e0-a823-6d421aea636d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.470081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-1b30b9e9-8bcf-465b-b52d-4eb43e7d1f36 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:06.470281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d05e5-9c2e-42e0-a823-6d421aea636d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:06.471249 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1b30b9e9-8bcf-465b-b52d-4eb43e7d1f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:06.472611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d05e5-9c2e-42e0-a823-6d421aea636d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-7e8d05e5-9c2e-42e0-a823-6d421aea636d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:06.492655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:06.493719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:06.495633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:06.495633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:06.495633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:06.495633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:06.495633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 367/743] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:06.495633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d05e5-9c2e-42e0-a823-6d421aea636d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:06.540674 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 377/744] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 20:18:06.541331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30b9e9-8bcf-465b-b52d-4eb43e7d1f36 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:06.598045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d05e5-9c2e-42e0-a823-6d421aea636d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:06.632403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114fe63-6eae-4f53-b3a9-1e43664ef158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:06.633061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114fe63-6eae-4f53-b3a9-1e43664ef158 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.633375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114fe63-6eae-4f53-b3a9-1e43664ef158 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.633656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114fe63-6eae-4f53-b3a9-1e43664ef158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.638958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30b9e9-8bcf-465b-b52d-4eb43e7d1f36 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:06.672519 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47c36f-e13c-4a24-8380-9ef65684eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:06.673346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47c36f-e13c-4a24-8380-9ef65684eec7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.673634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47c36f-e13c-4a24-8380-9ef65684eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.673912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47c36f-e13c-4a24-8380-9ef65684eec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.684809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47c36f-e13c-4a24-8380-9ef65684eec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:06.686286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47c36f-e13c-4a24-8380-9ef65684eec7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-ed47c36f-e13c-4a24-8380-9ef65684eec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:06.704355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:06.705379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:06.706271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:06.706271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:06.706271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:06.706271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:06.706271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 378/745] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:06.706561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47c36f-e13c-4a24-8380-9ef65684eec7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:06.707225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114fe63-6eae-4f53-b3a9-1e43664ef158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:06.708015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114fe63-6eae-4f53-b3a9-1e43664ef158 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:06.803511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47c36f-e13c-4a24-8380-9ef65684eec7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:06.808650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 368/746] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 20:18:06.809529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114fe63-6eae-4f53-b3a9-1e43664ef158 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:06.841661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cbcf5-8ba0-4171-ba7a-c580a32afea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:06.842331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbcf5-8ba0-4171-ba7a-c580a32afea1 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.842616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbcf5-8ba0-4171-ba7a-c580a32afea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.842902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbcf5-8ba0-4171-ba7a-c580a32afea1 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.843628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cbcf5-8ba0-4171-ba7a-c580a32afea1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:06.844987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cbcf5-8ba0-4171-ba7a-c580a32afea1 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:06.909121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114fe63-6eae-4f53-b3a9-1e43664ef158 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:06.942344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 379/747] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:18:06 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:06.943377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cbcf5-8ba0-4171-ba7a-c580a32afea1 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:06.955644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff218a4-9643-4f53-997d-a01f59643aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:06.956349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff218a4-9643-4f53-997d-a01f59643aab None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:06.956633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff218a4-9643-4f53-997d-a01f59643aab None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:06.956905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff218a4-9643-4f53-997d-a01f59643aab None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:06.957698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff218a4-9643-4f53-997d-a01f59643aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:06.958014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff218a4-9643-4f53-997d-a01f59643aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:06.960564 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff218a4-9643-4f53-997d-a01f59643aab None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:06.978695 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 369/748] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:06.978695 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff218a4-9643-4f53-997d-a01f59643aab None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:07.075049 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cbcf5-8ba0-4171-ba7a-c580a32afea1 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:07.103578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff218a4-9643-4f53-997d-a01f59643aab None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:07.119257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97188201-266b-48e7-a2dc-3b8d845da117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:07.119952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97188201-266b-48e7-a2dc-3b8d845da117 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:07.120236 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97188201-266b-48e7-a2dc-3b8d845da117 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:07.120510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97188201-266b-48e7-a2dc-3b8d845da117 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:07.121254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97188201-266b-48e7-a2dc-3b8d845da117 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:07.122695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97188201-266b-48e7-a2dc-3b8d845da117 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:07.140608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f471c2-0487-4074-b0c5-002145c2dc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:07.141303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f471c2-0487-4074-b0c5-002145c2dc6b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:07.141607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f471c2-0487-4074-b0c5-002145c2dc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:07.141880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f471c2-0487-4074-b0c5-002145c2dc6b None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:07.142614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f471c2-0487-4074-b0c5-002145c2dc6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:07.142927 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f471c2-0487-4074-b0c5-002145c2dc6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:07.144291 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f471c2-0487-4074-b0c5-002145c2dc6b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:07.157895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 370/749] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:07.158885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f471c2-0487-4074-b0c5-002145c2dc6b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:07.195504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 380/750] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:18:06 2022] POST /identity/v3/services => generated 240 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:07.196352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97188201-266b-48e7-a2dc-3b8d845da117 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:07.297266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f471c2-0487-4074-b0c5-002145c2dc6b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:07.344052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f32e82-fab4-4414-a895-0132f89a5455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:07.344879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32e82-fab4-4414-a895-0132f89a5455 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:07.345169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32e82-fab4-4414-a895-0132f89a5455 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:07.345507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32e82-fab4-4414-a895-0132f89a5455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:07.360660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f32e82-fab4-4414-a895-0132f89a5455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:07.362673 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97188201-266b-48e7-a2dc-3b8d845da117 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:07.363071 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f32e82-fab4-4414-a895-0132f89a5455 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-94f32e82-fab4-4414-a895-0132f89a5455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:07.390917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:07.392679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:07.394995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:07.394995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:07.394995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:07.394995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:07.394995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 371/751] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:07.394995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f32e82-fab4-4414-a895-0132f89a5455 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:07.439191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fcd75-436b-49ff-98e9-7873ceede4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:07.440211 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fcd75-436b-49ff-98e9-7873ceede4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:07.440319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fcd75-436b-49ff-98e9-7873ceede4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:07.440611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fcd75-436b-49ff-98e9-7873ceede4e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:07.455336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fcd75-436b-49ff-98e9-7873ceede4e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:07.456784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fcd75-436b-49ff-98e9-7873ceede4e6 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-8a3fcd75-436b-49ff-98e9-7873ceede4e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:07.474482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:07.476102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:07.477034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:07.477034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:07.477034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:07.477034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:07.477034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:07.477034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:07.477034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:07.477034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:07.477034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 20:18:07.477034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:07.479334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 381/752] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:07.481573 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fcd75-436b-49ff-98e9-7873ceede4e6 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:07.553989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f32e82-fab4-4414-a895-0132f89a5455 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:07.589531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d9069-546a-48ac-8b3a-a9cdb5c1070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:07.590406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d9069-546a-48ac-8b3a-a9cdb5c1070e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:07.590691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d9069-546a-48ac-8b3a-a9cdb5c1070e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:07.590972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d9069-546a-48ac-8b3a-a9cdb5c1070e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:07.592382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fcd75-436b-49ff-98e9-7873ceede4e6 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:07.598746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d9069-546a-48ac-8b3a-a9cdb5c1070e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:07.600697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d9069-546a-48ac-8b3a-a9cdb5c1070e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-4e0d9069-546a-48ac-8b3a-a9cdb5c1070e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:07.615885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:07.616836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:07.617859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:07.617859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:07.617859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:07.617859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:07.617859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:07.617859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:07.617859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:07.617859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:07.617859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 372/753] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:07.618352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d9069-546a-48ac-8b3a-a9cdb5c1070e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:07.634381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dee2d-c249-402c-80d4-6c18cea01b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:07.635114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dee2d-c249-402c-80d4-6c18cea01b58 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:07.635401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dee2d-c249-402c-80d4-6c18cea01b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:07.635687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dee2d-c249-402c-80d4-6c18cea01b58 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:07.636492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dee2d-c249-402c-80d4-6c18cea01b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:07.636815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dee2d-c249-402c-80d4-6c18cea01b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:07.638273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dee2d-c249-402c-80d4-6c18cea01b58 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:07.652591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 382/754] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:07.653502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dee2d-c249-402c-80d4-6c18cea01b58 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:07.733474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d9069-546a-48ac-8b3a-a9cdb5c1070e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:07.767230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dee2d-c249-402c-80d4-6c18cea01b58 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:07.767749 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1a92-a500-4049-80d9-d226d2810289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:07.768441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1a92-a500-4049-80d9-d226d2810289 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:07.768797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1a92-a500-4049-80d9-d226d2810289 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:07.769086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1a92-a500-4049-80d9-d226d2810289 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:07.769971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c1a92-a500-4049-80d9-d226d2810289 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:07.770284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c1a92-a500-4049-80d9-d226d2810289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:07.772379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c1a92-a500-4049-80d9-d226d2810289 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:07.796497 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 373/755] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 12 20:18:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:07.797401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1a92-a500-4049-80d9-d226d2810289 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:07.814325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93d8d2-9e3e-4f71-b9c4-d3730d7ceb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:07.815081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93d8d2-9e3e-4f71-b9c4-d3730d7ceb5d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:07.815374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93d8d2-9e3e-4f71-b9c4-d3730d7ceb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:07.815653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93d8d2-9e3e-4f71-b9c4-d3730d7ceb5d None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:07.816475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93d8d2-9e3e-4f71-b9c4-d3730d7ceb5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:07.816835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93d8d2-9e3e-4f71-b9c4-d3730d7ceb5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:07.819077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93d8d2-9e3e-4f71-b9c4-d3730d7ceb5d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:07.835610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 383/756] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:07.836414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93d8d2-9e3e-4f71-b9c4-d3730d7ceb5d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:07.935322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1a92-a500-4049-80d9-d226d2810289 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:07.964525 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93d8d2-9e3e-4f71-b9c4-d3730d7ceb5d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:07.972401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78db50-7133-4dc1-bfd0-bc3970a0486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:07.973589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78db50-7133-4dc1-bfd0-bc3970a0486e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:07.974074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78db50-7133-4dc1-bfd0-bc3970a0486e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:07.974588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78db50-7133-4dc1-bfd0-bc3970a0486e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:07.982904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78db50-7133-4dc1-bfd0-bc3970a0486e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:07.984651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78db50-7133-4dc1-bfd0-bc3970a0486e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ec78db50-7133-4dc1-bfd0-bc3970a0486e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:08.000069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:08.001014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:08.001978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:08.001978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:08.001978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:08.001978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:08.001978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:08.001978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:08.001978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:08.001978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:08.004616 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 374/757] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:08.006280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78db50-7133-4dc1-bfd0-bc3970a0486e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:08.013823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150d925-b116-4900-82c6-35a862ff1a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:08.014497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150d925-b116-4900-82c6-35a862ff1a45 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:08.015260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150d925-b116-4900-82c6-35a862ff1a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:08.015587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150d925-b116-4900-82c6-35a862ff1a45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:08.089175 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150d925-b116-4900-82c6-35a862ff1a45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:08.090665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150d925-b116-4900-82c6-35a862ff1a45 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:08.123445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78db50-7133-4dc1-bfd0-bc3970a0486e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:08.161052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274f557-3aec-45cf-9b51-ff72e0351e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:08.162497 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274f557-3aec-45cf-9b51-ff72e0351e8a None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:08.162992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274f557-3aec-45cf-9b51-ff72e0351e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:08.163466 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274f557-3aec-45cf-9b51-ff72e0351e8a None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/156646eda779439784ddbc7d1fbd5b90/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:08.165794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274f557-3aec-45cf-9b51-ff72e0351e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=156646eda779439784ddbc7d1fbd5b90, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:08.167514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274f557-3aec-45cf-9b51-ff72e0351e8a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:08.214880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 384/758] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:18:08.216074 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150d925-b116-4900-82c6-35a862ff1a45 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:08.260971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 375/759] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:18:08 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/156646eda779439784ddbc7d1fbd5b90/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:18:08.264653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274f557-3aec-45cf-9b51-ff72e0351e8a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:08.418513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150d925-b116-4900-82c6-35a862ff1a45 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:08.441420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274f557-3aec-45cf-9b51-ff72e0351e8a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:08.487924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ef093-4b34-4dd9-944d-f468c3bd0488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:08.488755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef093-4b34-4dd9-944d-f468c3bd0488 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:08.489040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef093-4b34-4dd9-944d-f468c3bd0488 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:08.489339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef093-4b34-4dd9-944d-f468c3bd0488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:08.504817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ef093-4b34-4dd9-944d-f468c3bd0488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:08.507210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ef093-4b34-4dd9-944d-f468c3bd0488 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:08.508849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea3bb8-dd24-41e5-b8a0-a166d83e593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:08.509678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3bb8-dd24-41e5-b8a0-a166d83e593a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:08.509963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3bb8-dd24-41e5-b8a0-a166d83e593a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:08.510243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3bb8-dd24-41e5-b8a0-a166d83e593a None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:08.511126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea3bb8-dd24-41e5-b8a0-a166d83e593a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:08.511443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea3bb8-dd24-41e5-b8a0-a166d83e593a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:08.513037 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea3bb8-dd24-41e5-b8a0-a166d83e593a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:08.532013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 385/760] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9f2ef093-4b34-4dd9-944d-f468c3bd0488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:08.532212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:08.533051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:08.534017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:08.534017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:08.534017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:08.534017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:08.534245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea3bb8-dd24-41e5-b8a0-a166d83e593a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:08.534864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 376/761] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:08.545345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ef093-4b34-4dd9-944d-f468c3bd0488 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:08.645173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea3bb8-dd24-41e5-b8a0-a166d83e593a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:08.658316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ef093-4b34-4dd9-944d-f468c3bd0488 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:08.681461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e6622-ac9e-41f4-869a-f78f649c5e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:08.682063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e6622-ac9e-41f4-869a-f78f649c5e09 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:08.682346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e6622-ac9e-41f4-869a-f78f649c5e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:08.682622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e6622-ac9e-41f4-869a-f78f649c5e09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:08.683468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e6622-ac9e-41f4-869a-f78f649c5e09 None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=650c0f54ab04442dba1af80d84417da0) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:08.683778 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e6622-ac9e-41f4-869a-f78f649c5e09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:08.685214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e6622-ac9e-41f4-869a-f78f649c5e09 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:08.691476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 386/762] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:08 2022] GET /identity/v3/role_assignments?user.id=650c0f54ab04442dba1af80d84417da0&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:08.714373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46128794-3738-495d-a07f-eaeae9618a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:08.715342 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46128794-3738-495d-a07f-eaeae9618a50 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:08.715633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46128794-3738-495d-a07f-eaeae9618a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:08.715969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46128794-3738-495d-a07f-eaeae9618a50 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:08.716787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46128794-3738-495d-a07f-eaeae9618a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:08.717101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46128794-3738-495d-a07f-eaeae9618a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:08.718522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46128794-3738-495d-a07f-eaeae9618a50 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:08.736872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 377/763] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:08.743036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e6622-ac9e-41f4-869a-f78f649c5e09 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:08.864007 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e6622-ac9e-41f4-869a-f78f649c5e09 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:08.902250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dee2e-f13f-49cf-957d-1e69195d4eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:08.903082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dee2e-f13f-49cf-957d-1e69195d4eaf None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:08.903364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dee2e-f13f-49cf-957d-1e69195d4eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:08.903642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dee2e-f13f-49cf-957d-1e69195d4eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:08.911541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004dee2e-f13f-49cf-957d-1e69195d4eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:08.914137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004dee2e-f13f-49cf-957d-1e69195d4eaf None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-004dee2e-f13f-49cf-957d-1e69195d4eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:08.931202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:08.933485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:08.935636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:08.935636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:08.935636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:08.935636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:08.935636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:08.935636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:08.935636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:08.935636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:08.935636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 387/764] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:08.938697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46128794-3738-495d-a07f-eaeae9618a50 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:09.092856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46128794-3738-495d-a07f-eaeae9618a50 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:09.136603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d7433-5783-434b-add9-c187b55c659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:09.141305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d7433-5783-434b-add9-c187b55c659d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:09.141305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d7433-5783-434b-add9-c187b55c659d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:09.141305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d7433-5783-434b-add9-c187b55c659d None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:09.141305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d7433-5783-434b-add9-c187b55c659d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:09.141305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d7433-5783-434b-add9-c187b55c659d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:09.141305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d7433-5783-434b-add9-c187b55c659d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:09.153916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 378/765] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:09.163054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dee2e-f13f-49cf-957d-1e69195d4eaf None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:09.312173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dee2e-f13f-49cf-957d-1e69195d4eaf None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:09.366594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcf678-f28a-43a6-9a22-ed2c19330bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:09.367263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcf678-f28a-43a6-9a22-ed2c19330bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:09.367551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcf678-f28a-43a6-9a22-ed2c19330bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:09.367828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcf678-f28a-43a6-9a22-ed2c19330bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:09.368670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcf678-f28a-43a6-9a22-ed2c19330bc4 None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=766497e7e0614adea5769b05f0c1cdcf) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:09.369247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcf678-f28a-43a6-9a22-ed2c19330bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:09.370711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcf678-f28a-43a6-9a22-ed2c19330bc4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:09.382632 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 388/766] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:09 2022] GET /identity/v3/role_assignments?user.id=766497e7e0614adea5769b05f0c1cdcf&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=4ae0665802b946be870ab06274297a1d => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:09.872331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025ef4-25e7-469a-9493-4e0331f1e603 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:09.872824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025ef4-25e7-469a-9493-4e0331f1e603 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:09.872900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025ef4-25e7-469a-9493-4e0331f1e603 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:09.874555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 379/767] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:09.880038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc7441-0228-415a-8345-27166fb48243 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:09.880494 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc7441-0228-415a-8345-27166fb48243 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:09.881301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc7441-0228-415a-8345-27166fb48243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:09.898373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-72bc7441-0228-415a-8345-27166fb48243 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:09.899627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-72bc7441-0228-415a-8345-27166fb48243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:09.932947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d64ff-59c0-478d-b63d-109b974380a9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:09.933258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d64ff-59c0-478d-b63d-109b974380a9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:09.933542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d64ff-59c0-478d-b63d-109b974380a9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:09.936503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 380/768] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:09.940856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f522d-2874-453a-920c-dd12a0a977df None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:09.941183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f522d-2874-453a-920c-dd12a0a977df None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:09.941462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f522d-2874-453a-920c-dd12a0a977df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:09.959651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6c5f522d-2874-453a-920c-dd12a0a977df None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:09.960894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6c5f522d-2874-453a-920c-dd12a0a977df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:09.971542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 389/769] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:09.995738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc7441-0228-415a-8345-27166fb48243 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:10.037377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 381/770] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:10.057431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f522d-2874-453a-920c-dd12a0a977df None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:10.100017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc7441-0228-415a-8345-27166fb48243 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:10.144143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df41984-c1b7-49fa-979e-f8a70dfb6bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:10.144888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df41984-c1b7-49fa-979e-f8a70dfb6bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:10.145265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df41984-c1b7-49fa-979e-f8a70dfb6bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:10.145569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df41984-c1b7-49fa-979e-f8a70dfb6bf2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:10.146505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df41984-c1b7-49fa-979e-f8a70dfb6bf2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:10.147976 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df41984-c1b7-49fa-979e-f8a70dfb6bf2 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:10.164693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f522d-2874-453a-920c-dd12a0a977df None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-7df41984-c1b7-49fa-979e-f8a70dfb6bf2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:10.174478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:10.176115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:10.178275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 390/771] 10.222.0.59 () {56 vars in 1129 bytes} [Thu May 12 20:18:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:10.182627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df41984-c1b7-49fa-979e-f8a70dfb6bf2 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:10.216833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45628649-788a-4c67-aa3d-ab0ce858189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:10.218049 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628649-788a-4c67-aa3d-ab0ce858189d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:10.218552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628649-788a-4c67-aa3d-ab0ce858189d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:10.219044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628649-788a-4c67-aa3d-ab0ce858189d None admin] PATH_INFO: `/v3/services/network` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:10.219910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45628649-788a-4c67-aa3d-ab0ce858189d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:10.221500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45628649-788a-4c67-aa3d-ab0ce858189d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-45628649-788a-4c67-aa3d-ab0ce858189d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:10.243781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:10.245088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 20:18:10.245959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:10.255233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 382/772] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:10 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:10.261151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45628649-788a-4c67-aa3d-ab0ce858189d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:10.334881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df41984-c1b7-49fa-979e-f8a70dfb6bf2 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:10.371042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb2bef-c0fb-489c-9d64-7745685d34e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:10.371537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45628649-788a-4c67-aa3d-ab0ce858189d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:10.371721 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb2bef-c0fb-489c-9d64-7745685d34e8 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:10.372003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb2bef-c0fb-489c-9d64-7745685d34e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:10.372285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb2bef-c0fb-489c-9d64-7745685d34e8 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:10.373010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb2bef-c0fb-489c-9d64-7745685d34e8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:10.373345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb2bef-c0fb-489c-9d64-7745685d34e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:10.374728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb2bef-c0fb-489c-9d64-7745685d34e8 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:10.379891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 391/773] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 12 20:18:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:10.385623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb2bef-c0fb-489c-9d64-7745685d34e8 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:10.419165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cac03a-4f3f-4553-b9ef-3c94e84ce7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:10.420249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cac03a-4f3f-4553-b9ef-3c94e84ce7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:10.420781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cac03a-4f3f-4553-b9ef-3c94e84ce7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:10.421262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cac03a-4f3f-4553-b9ef-3c94e84ce7b4 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:10.422382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cac03a-4f3f-4553-b9ef-3c94e84ce7b4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:10.422896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cac03a-4f3f-4553-b9ef-3c94e84ce7b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:10.424539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cac03a-4f3f-4553-b9ef-3c94e84ce7b4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:10.434315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 383/774] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:10.439590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cac03a-4f3f-4553-b9ef-3c94e84ce7b4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:10.493343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb2bef-c0fb-489c-9d64-7745685d34e8 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:10.529951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f206d3-cae2-42bb-b43c-eb2eb77d9972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:10.530636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f206d3-cae2-42bb-b43c-eb2eb77d9972 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:10.530925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f206d3-cae2-42bb-b43c-eb2eb77d9972 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:10.531215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f206d3-cae2-42bb-b43c-eb2eb77d9972 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:10.531932 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f206d3-cae2-42bb-b43c-eb2eb77d9972 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:10.532249 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f206d3-cae2-42bb-b43c-eb2eb77d9972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:10.533671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f206d3-cae2-42bb-b43c-eb2eb77d9972 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:10.541257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 392/775] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 12 20:18:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:10.546851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f206d3-cae2-42bb-b43c-eb2eb77d9972 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:10.583477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cac03a-4f3f-4553-b9ef-3c94e84ce7b4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:10.664663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f206d3-cae2-42bb-b43c-eb2eb77d9972 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:10.686096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd2e1e-90ea-4c10-909d-26b89f545b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:10.686715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd2e1e-90ea-4c10-909d-26b89f545b59 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:10.687007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd2e1e-90ea-4c10-909d-26b89f545b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:10.687295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd2e1e-90ea-4c10-909d-26b89f545b59 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:10.688022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd2e1e-90ea-4c10-909d-26b89f545b59 None admin] RBAC: Adding query filter params (type=network) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:10.688339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd2e1e-90ea-4c10-909d-26b89f545b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:10.689761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd2e1e-90ea-4c10-909d-26b89f545b59 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:10.700792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 384/776] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:10.706033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39229a-fde3-416e-9492-600e7626fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:10.706382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd2e1e-90ea-4c10-909d-26b89f545b59 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:10.707377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39229a-fde3-416e-9492-600e7626fb56 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:10.707874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39229a-fde3-416e-9492-600e7626fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:10.708436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39229a-fde3-416e-9492-600e7626fb56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:10.709602 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39229a-fde3-416e-9492-600e7626fb56 None admin] RBAC: Adding query filter params (interface=public, service_id=b702d30b6df74cf88c9f7da505644d5a, region_id=RegionOne) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:10.710153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39229a-fde3-416e-9492-600e7626fb56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:10.712098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39229a-fde3-416e-9492-600e7626fb56 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:10.722003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 393/777] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 12 20:18:10 2022] GET /identity/v3/endpoints?service_id=b702d30b6df74cf88c9f7da505644d5a&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:10.727827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39229a-fde3-416e-9492-600e7626fb56 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:10.833667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39229a-fde3-416e-9492-600e7626fb56 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:10.870541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b114454-2ba2-4781-aec5-c82ed0258b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:10.871338 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114454-2ba2-4781-aec5-c82ed0258b63 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:10.871721 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114454-2ba2-4781-aec5-c82ed0258b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:10.872077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114454-2ba2-4781-aec5-c82ed0258b63 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:10.872848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b114454-2ba2-4781-aec5-c82ed0258b63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:10.874343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b114454-2ba2-4781-aec5-c82ed0258b63 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:10.880171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 394/778] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 12 20:18:10 2022] GET /identity/v3/services => generated 772 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:10.953659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd2e1e-90ea-4c10-909d-26b89f545b59 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:11.009506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34748d94-02f3-44c9-ba4e-4de11ad14373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:11.010598 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748d94-02f3-44c9-ba4e-4de11ad14373 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:11.011065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748d94-02f3-44c9-ba4e-4de11ad14373 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:11.011588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34748d94-02f3-44c9-ba4e-4de11ad14373 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:11.012606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748d94-02f3-44c9-ba4e-4de11ad14373 None admin] RBAC: Adding query filter params (interface=public, service_id=cb63ef6ce39a4873b2d6dbc2e852203e, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:11.013108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748d94-02f3-44c9-ba4e-4de11ad14373 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:11.014743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34748d94-02f3-44c9-ba4e-4de11ad14373 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:11.029302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 385/779] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 12 20:18:10 2022] GET /identity/v3/endpoints?service_id=cb63ef6ce39a4873b2d6dbc2e852203e&interface=public®ion_id=RegionOne => generated 194 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:11.030291 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b114454-2ba2-4781-aec5-c82ed0258b63 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:11.193216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b114454-2ba2-4781-aec5-c82ed0258b63 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:11.236484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14f8fe-a5c6-4191-a71b-e731a4226dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:11.237075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f8fe-a5c6-4191-a71b-e731a4226dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:11.237387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f8fe-a5c6-4191-a71b-e731a4226dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:11.237668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14f8fe-a5c6-4191-a71b-e731a4226dd0 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:11.238357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14f8fe-a5c6-4191-a71b-e731a4226dd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:11.239726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14f8fe-a5c6-4191-a71b-e731a4226dd0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:11.253545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 395/780] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 12 20:18:11 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:11.294305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f2e7-0120-43ee-9658-a6512c4b406a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:11.294949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f2e7-0120-43ee-9658-a6512c4b406a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:11.295452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f2e7-0120-43ee-9658-a6512c4b406a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:11.297069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 386/781] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:11.303074 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bd5b-f2e7-4428-83f1-ae3c72695298 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:11.303544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bd5b-f2e7-4428-83f1-ae3c72695298 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:11.303832 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bd5b-f2e7-4428-83f1-ae3c72695298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:11.321844 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5880bd5b-f2e7-4428-83f1-ae3c72695298 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:11.323050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5880bd5b-f2e7-4428-83f1-ae3c72695298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:11.424246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 396/782] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:11.464882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f2e7-0120-43ee-9658-a6512c4b406a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:11.590262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f2e7-0120-43ee-9658-a6512c4b406a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:11.626326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380bce6-b218-4cc3-9323-7831707c7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:11.627575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380bce6-b218-4cc3-9323-7831707c7089 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:11.628081 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380bce6-b218-4cc3-9323-7831707c7089 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:11.628735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380bce6-b218-4cc3-9323-7831707c7089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:11.642596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380bce6-b218-4cc3-9323-7831707c7089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9380bce6-b218-4cc3-9323-7831707c7089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:11.650670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:11.651800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:11.652625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:11.655644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 387/783] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:11.662997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880bd5b-f2e7-4428-83f1-ae3c72695298 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:11.691732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab584c-a12a-432e-a1b5-9b80ae454427 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:11.692351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab584c-a12a-432e-a1b5-9b80ae454427 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:11.692827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab584c-a12a-432e-a1b5-9b80ae454427 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:11.695015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 388/784] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:11.704886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50847ffa-82fb-4770-af67-556e655722e8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:11.705194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50847ffa-82fb-4770-af67-556e655722e8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:11.705486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50847ffa-82fb-4770-af67-556e655722e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:11.731272 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-50847ffa-82fb-4770-af67-556e655722e8 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:11.734629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-50847ffa-82fb-4770-af67-556e655722e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:11.863639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880bd5b-f2e7-4428-83f1-ae3c72695298 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:11.903569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 389/785] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:11.947870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627d5bb-7d4b-43e7-afda-c1674bfcfb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:11.949413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627d5bb-7d4b-43e7-afda-c1674bfcfb80 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:11.949937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627d5bb-7d4b-43e7-afda-c1674bfcfb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:11.950416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627d5bb-7d4b-43e7-afda-c1674bfcfb80 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:11.951439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627d5bb-7d4b-43e7-afda-c1674bfcfb80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:11.951971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627d5bb-7d4b-43e7-afda-c1674bfcfb80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:11.953657 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627d5bb-7d4b-43e7-afda-c1674bfcfb80 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:11.968392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 397/786] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:18:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:11.973454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50847ffa-82fb-4770-af67-556e655722e8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:11.984215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627d5bb-7d4b-43e7-afda-c1674bfcfb80 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:12.172871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50847ffa-82fb-4770-af67-556e655722e8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:12.208827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627d5bb-7d4b-43e7-afda-c1674bfcfb80 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:12.211417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc421ba-7a6e-4668-a888-26270ab44b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:12.212442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc421ba-7a6e-4668-a888-26270ab44b9f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:12.212922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc421ba-7a6e-4668-a888-26270ab44b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:12.213621 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc421ba-7a6e-4668-a888-26270ab44b9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:12.225865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc421ba-7a6e-4668-a888-26270ab44b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-adc421ba-7a6e-4668-a888-26270ab44b9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:12.234166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:12.235097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:18:12.235949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:12.238678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 390/787] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:18:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:12.245475 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc421ba-7a6e-4668-a888-26270ab44b9f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:12.251964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243246e-f923-4cac-bb02-82a6fea0ba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:12.257437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243246e-f923-4cac-bb02-82a6fea0ba8f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:12.257976 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243246e-f923-4cac-bb02-82a6fea0ba8f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:12.258500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243246e-f923-4cac-bb02-82a6fea0ba8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:12.288665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243246e-f923-4cac-bb02-82a6fea0ba8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:12.290568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243246e-f923-4cac-bb02-82a6fea0ba8f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-1243246e-f923-4cac-bb02-82a6fea0ba8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:12.334290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:12.335251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:12.336144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:12.336144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:12.336144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:12.336144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:12.337030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 398/788] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:12.343667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243246e-f923-4cac-bb02-82a6fea0ba8f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:12.410162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc421ba-7a6e-4668-a888-26270ab44b9f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:12.444839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b767c9-36a7-479c-8906-1b872420953d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:12.445487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b767c9-36a7-479c-8906-1b872420953d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:12.445885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b767c9-36a7-479c-8906-1b872420953d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:12.446062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b767c9-36a7-479c-8906-1b872420953d None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:12.446810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b767c9-36a7-479c-8906-1b872420953d None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:12.447125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b767c9-36a7-479c-8906-1b872420953d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:12.448507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b767c9-36a7-479c-8906-1b872420953d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:12.457919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 391/789] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:18:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:12.459324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e839e6-5355-4fa7-884b-2b2e07f926b8 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:12.459618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e839e6-5355-4fa7-884b-2b2e07f926b8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:12.459904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e839e6-5355-4fa7-884b-2b2e07f926b8 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:12.465941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 392/790] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:12.467984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd726-dd4b-4cd7-abb2-4be0fd1e7c20 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:12.468282 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd726-dd4b-4cd7-abb2-4be0fd1e7c20 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:12.468571 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd726-dd4b-4cd7-abb2-4be0fd1e7c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:12.486993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-36efd726-dd4b-4cd7-abb2-4be0fd1e7c20 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:12.488203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-36efd726-dd4b-4cd7-abb2-4be0fd1e7c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:12.498076 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243246e-f923-4cac-bb02-82a6fea0ba8f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:12.534679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f791c6-cb91-4306-aaf3-680995c0bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:12.535647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f791c6-cb91-4306-aaf3-680995c0bd8a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:12.535936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f791c6-cb91-4306-aaf3-680995c0bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:12.536212 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f791c6-cb91-4306-aaf3-680995c0bd8a None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:12.538077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f791c6-cb91-4306-aaf3-680995c0bd8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:12.538443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f791c6-cb91-4306-aaf3-680995c0bd8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:12.540538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f791c6-cb91-4306-aaf3-680995c0bd8a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:12.557503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 399/791] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:12.558378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f791c6-cb91-4306-aaf3-680995c0bd8a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:12.565785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 393/792] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:12.566663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd726-dd4b-4cd7-abb2-4be0fd1e7c20 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:12.673547 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f791c6-cb91-4306-aaf3-680995c0bd8a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:12.715333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee861d-7bef-4659-bb52-960a44d2e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:12.716210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee861d-7bef-4659-bb52-960a44d2e5ff None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:12.716625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee861d-7bef-4659-bb52-960a44d2e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:12.716905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee861d-7bef-4659-bb52-960a44d2e5ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:12.719733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd726-dd4b-4cd7-abb2-4be0fd1e7c20 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:12.729412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee861d-7bef-4659-bb52-960a44d2e5ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:12.731368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee861d-7bef-4659-bb52-960a44d2e5ff None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-e4ee861d-7bef-4659-bb52-960a44d2e5ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:12.755151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:12.756154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:12.757164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:12.757164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:12.757164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:12.757164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:12.757878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 400/793] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:12.758570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee861d-7bef-4659-bb52-960a44d2e5ff None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:12.765959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f5ec3-a08c-4ffe-a24c-351c9f24e6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:12.766779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f5ec3-a08c-4ffe-a24c-351c9f24e6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:12.767063 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f5ec3-a08c-4ffe-a24c-351c9f24e6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:12.767398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f5ec3-a08c-4ffe-a24c-351c9f24e6c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:12.776645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f5ec3-a08c-4ffe-a24c-351c9f24e6c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:12.778123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f5ec3-a08c-4ffe-a24c-351c9f24e6c1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-732f5ec3-a08c-4ffe-a24c-351c9f24e6c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:12.794502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:12.796716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 394/794] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 12 20:18:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:12.798228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f5ec3-a08c-4ffe-a24c-351c9f24e6c1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:12.884950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee861d-7bef-4659-bb52-960a44d2e5ff None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:12.917613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f5ec3-a08c-4ffe-a24c-351c9f24e6c1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:12.922119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b4379-2e19-47be-af7f-b0f90b9f3eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:12.923081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b4379-2e19-47be-af7f-b0f90b9f3eaa None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:12.923464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b4379-2e19-47be-af7f-b0f90b9f3eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:12.933320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b4379-2e19-47be-af7f-b0f90b9f3eaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:12.935892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b4379-2e19-47be-af7f-b0f90b9f3eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-830b4379-2e19-47be-af7f-b0f90b9f3eaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:12.944164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:12.945299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:12.946126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:12.946753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 401/795] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:12.947851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b4379-2e19-47be-af7f-b0f90b9f3eaa None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:12.952828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa9a8-19e8-46e2-9c59-ae55350db668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:12.953546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa9a8-19e8-46e2-9c59-ae55350db668 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:12.953835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa9a8-19e8-46e2-9c59-ae55350db668 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:12.954117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aa9a8-19e8-46e2-9c59-ae55350db668 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:12.954855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa9a8-19e8-46e2-9c59-ae55350db668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:12.955161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa9a8-19e8-46e2-9c59-ae55350db668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:12.956545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aa9a8-19e8-46e2-9c59-ae55350db668 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:12.970406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 395/796] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:12.971272 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa9a8-19e8-46e2-9c59-ae55350db668 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:13.059354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b4379-2e19-47be-af7f-b0f90b9f3eaa None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:13.072677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aa9a8-19e8-46e2-9c59-ae55350db668 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:13.095594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25410c2-fcaa-4a8c-8a9d-5dbea6ec2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:13.096278 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25410c2-fcaa-4a8c-8a9d-5dbea6ec2371 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.096561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25410c2-fcaa-4a8c-8a9d-5dbea6ec2371 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.097060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25410c2-fcaa-4a8c-8a9d-5dbea6ec2371 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.097953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25410c2-fcaa-4a8c-8a9d-5dbea6ec2371 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:13.098270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25410c2-fcaa-4a8c-8a9d-5dbea6ec2371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:13.100329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25410c2-fcaa-4a8c-8a9d-5dbea6ec2371 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:13.109360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e8311-67e7-42d3-a896-2e53059413db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:13.110047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e8311-67e7-42d3-a896-2e53059413db None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.110333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e8311-67e7-42d3-a896-2e53059413db None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.110619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e8311-67e7-42d3-a896-2e53059413db None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.111381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e8311-67e7-42d3-a896-2e53059413db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:13.111693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e8311-67e7-42d3-a896-2e53059413db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:13.113085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e8311-67e7-42d3-a896-2e53059413db None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:13.119535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 402/797] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 12 20:18:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:13.120516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25410c2-fcaa-4a8c-8a9d-5dbea6ec2371 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:13.122976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 396/798] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:18:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:13.130912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e8311-67e7-42d3-a896-2e53059413db None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:13.242033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25410c2-fcaa-4a8c-8a9d-5dbea6ec2371 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:13.251896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e8311-67e7-42d3-a896-2e53059413db None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:13.286495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f409e4-8e53-45ba-bd8e-79af70abd01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:13.287641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f409e4-8e53-45ba-bd8e-79af70abd01b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.288242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f409e4-8e53-45ba-bd8e-79af70abd01b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.288615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f409e4-8e53-45ba-bd8e-79af70abd01b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.292290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f4b73-80b9-4406-85f1-61b89ebb532d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:13.293206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f4b73-80b9-4406-85f1-61b89ebb532d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.293628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f4b73-80b9-4406-85f1-61b89ebb532d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.293999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f4b73-80b9-4406-85f1-61b89ebb532d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.296814 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f409e4-8e53-45ba-bd8e-79af70abd01b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:13.298782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f409e4-8e53-45ba-bd8e-79af70abd01b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:13.306528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f4b73-80b9-4406-85f1-61b89ebb532d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:13.308137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f4b73-80b9-4406-85f1-61b89ebb532d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-88f409e4-8e53-45ba-bd8e-79af70abd01b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:13.317206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:13.319208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 403/799] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 12 20:18:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:13.320945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f409e4-8e53-45ba-bd8e-79af70abd01b None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-0d3f4b73-80b9-4406-85f1-61b89ebb532d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:13.334103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:13.336646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:13.339306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:13.339306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:13.339306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:13.339306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:13.339306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 397/800] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:13.339306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f4b73-80b9-4406-85f1-61b89ebb532d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:13.444933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f409e4-8e53-45ba-bd8e-79af70abd01b None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:13.470064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f4b73-80b9-4406-85f1-61b89ebb532d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:13.497886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12558d-7128-440c-9bca-33a91aa33512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:13.497886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12558d-7128-440c-9bca-33a91aa33512 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.499029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12558d-7128-440c-9bca-33a91aa33512 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.499322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12558d-7128-440c-9bca-33a91aa33512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.520649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ddfad-ecb2-475f-855d-16407662ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:13.521648 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ddfad-ecb2-475f-855d-16407662ee21 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.521941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ddfad-ecb2-475f-855d-16407662ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.522223 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ddfad-ecb2-475f-855d-16407662ee21 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.523342 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ddfad-ecb2-475f-855d-16407662ee21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:13.523661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ddfad-ecb2-475f-855d-16407662ee21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:13.525770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ddfad-ecb2-475f-855d-16407662ee21 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:13.549299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 398/801] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 12 20:18:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:13.550168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ddfad-ecb2-475f-855d-16407662ee21 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:13.587445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12558d-7128-440c-9bca-33a91aa33512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:13.588942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12558d-7128-440c-9bca-33a91aa33512 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:13.671414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ddfad-ecb2-475f-855d-16407662ee21 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:13.704960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 404/802] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:18:13.706040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12558d-7128-440c-9bca-33a91aa33512 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:13.709133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74b60c-aba0-4973-9fc6-c2a2007819d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:13.710293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74b60c-aba0-4973-9fc6-c2a2007819d2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.711681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74b60c-aba0-4973-9fc6-c2a2007819d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.711681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74b60c-aba0-4973-9fc6-c2a2007819d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.711681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74b60c-aba0-4973-9fc6-c2a2007819d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:13.712029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74b60c-aba0-4973-9fc6-c2a2007819d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:13.713242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74b60c-aba0-4973-9fc6-c2a2007819d2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:13.728501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 399/803] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:13.730440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88318a4f-80ad-41a2-8ded-5f2a4bfaf4e0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.730730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88318a4f-80ad-41a2-8ded-5f2a4bfaf4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.731011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88318a4f-80ad-41a2-8ded-5f2a4bfaf4e0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.736603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 400/804] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:13.736603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88318a4f-80ad-41a2-8ded-5f2a4bfaf4e0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:13.834757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12558d-7128-440c-9bca-33a91aa33512 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:13.853702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88318a4f-80ad-41a2-8ded-5f2a4bfaf4e0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:13.872168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ec98a-6ad8-4cc7-9b0d-ce1d75f62e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:13.872971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ec98a-6ad8-4cc7-9b0d-ce1d75f62e35 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.873254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ec98a-6ad8-4cc7-9b0d-ce1d75f62e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.873558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ec98a-6ad8-4cc7-9b0d-ce1d75f62e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.884863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ec98a-6ad8-4cc7-9b0d-ce1d75f62e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:13.886473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ec98a-6ad8-4cc7-9b0d-ce1d75f62e35 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:13.891661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67491f-1a57-4a44-86da-4915438c3b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:13.892468 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67491f-1a57-4a44-86da-4915438c3b85 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.892752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67491f-1a57-4a44-86da-4915438c3b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.893027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67491f-1a57-4a44-86da-4915438c3b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.904258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67491f-1a57-4a44-86da-4915438c3b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-ad8ec98a-6ad8-4cc7-9b0d-ce1d75f62e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:13.905014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:13.905942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:13.906837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:13.906837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:13.906837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:13.906837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:13.907066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67491f-1a57-4a44-86da-4915438c3b85 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:13.907183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 405/805] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:13.907710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ec98a-6ad8-4cc7-9b0d-ce1d75f62e35 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ea67491f-1a57-4a44-86da-4915438c3b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:13.932169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:13.934064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:13.935802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:13.935802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:13.935802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:13.935802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:13.935802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 401/806] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:13.935802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d9aca-5ee4-4bc0-a194-1f79862c97db None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:13.935802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d9aca-5ee4-4bc0-a194-1f79862c97db None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:13.935802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d9aca-5ee4-4bc0-a194-1f79862c97db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:13.952900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-451d9aca-5ee4-4bc0-a194-1f79862c97db None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:13.954165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-451d9aca-5ee4-4bc0-a194-1f79862c97db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:14.012757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ec98a-6ad8-4cc7-9b0d-ce1d75f62e35 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.030134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 402/807] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:14.030990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d9aca-5ee4-4bc0-a194-1f79862c97db None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.063021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d11271-01ec-47f9-b790-253154af09f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.063920 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d11271-01ec-47f9-b790-253154af09f4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.064201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d11271-01ec-47f9-b790-253154af09f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.064475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d11271-01ec-47f9-b790-253154af09f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.074401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d11271-01ec-47f9-b790-253154af09f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.075915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d11271-01ec-47f9-b790-253154af09f4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-24d11271-01ec-47f9-b790-253154af09f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:14.092317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:14.093583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 406/808] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:14.095105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3881bd-9746-40ae-947b-ec02e7de6916 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.095902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3881bd-9746-40ae-947b-ec02e7de6916 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.095902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3881bd-9746-40ae-947b-ec02e7de6916 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.096818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 407/809] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:14.097531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3881bd-9746-40ae-947b-ec02e7de6916 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.151743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d9aca-5ee4-4bc0-a194-1f79862c97db None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.187705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb761526-c4f5-4f63-833e-b6a89441777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.188391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb761526-c4f5-4f63-833e-b6a89441777f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.188678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb761526-c4f5-4f63-833e-b6a89441777f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.188963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb761526-c4f5-4f63-833e-b6a89441777f None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.189735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb761526-c4f5-4f63-833e-b6a89441777f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:14.190046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb761526-c4f5-4f63-833e-b6a89441777f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.191425 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb761526-c4f5-4f63-833e-b6a89441777f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.203775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3881bd-9746-40ae-947b-ec02e7de6916 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.204941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 403/810] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:14.205886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb761526-c4f5-4f63-833e-b6a89441777f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.238094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4e381-7233-4f97-b367-791e1203eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.238763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4e381-7233-4f97-b367-791e1203eff2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.239052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4e381-7233-4f97-b367-791e1203eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.239341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4e381-7233-4f97-b367-791e1203eff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.240572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4e381-7233-4f97-b367-791e1203eff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:14.240878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4e381-7233-4f97-b367-791e1203eff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.242318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4e381-7233-4f97-b367-791e1203eff2 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.253958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 408/811] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:14.255361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1d54-7b0d-47c4-baec-a36cc54eefc9 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.256138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1d54-7b0d-47c4-baec-a36cc54eefc9 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.256419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1d54-7b0d-47c4-baec-a36cc54eefc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.274020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-c40e1d54-7b0d-47c4-baec-a36cc54eefc9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:14.275226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c40e1d54-7b0d-47c4-baec-a36cc54eefc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:14.317155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb761526-c4f5-4f63-833e-b6a89441777f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.343091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 409/812] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:14.343868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1d54-7b0d-47c4-baec-a36cc54eefc9 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.361069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83689fa-5776-444e-bf1c-976121b512a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.361920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83689fa-5776-444e-bf1c-976121b512a8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.362210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83689fa-5776-444e-bf1c-976121b512a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.362481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83689fa-5776-444e-bf1c-976121b512a8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.363134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83689fa-5776-444e-bf1c-976121b512a8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.364499 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83689fa-5776-444e-bf1c-976121b512a8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-a83689fa-5776-444e-bf1c-976121b512a8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:14.377792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:14.378931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:14.379765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 404/813] 10.222.0.59 () {56 vars in 1129 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:14.381393 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83689fa-5776-444e-bf1c-976121b512a8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.443732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1d54-7b0d-47c4-baec-a36cc54eefc9 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.477210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33892661-b88e-4622-8561-f692ac7cf347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.477919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33892661-b88e-4622-8561-f692ac7cf347 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.478203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33892661-b88e-4622-8561-f692ac7cf347 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.478485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33892661-b88e-4622-8561-f692ac7cf347 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.479338 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33892661-b88e-4622-8561-f692ac7cf347 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:14.479655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33892661-b88e-4622-8561-f692ac7cf347 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.481085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33892661-b88e-4622-8561-f692ac7cf347 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.483252 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83689fa-5776-444e-bf1c-976121b512a8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.499413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 410/814] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:14.500084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33892661-b88e-4622-8561-f692ac7cf347 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.522146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5611cf2-8971-4c1f-9fd2-f12ce74ef27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.522949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5611cf2-8971-4c1f-9fd2-f12ce74ef27a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.523236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5611cf2-8971-4c1f-9fd2-f12ce74ef27a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.523529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5611cf2-8971-4c1f-9fd2-f12ce74ef27a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.530263 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5611cf2-8971-4c1f-9fd2-f12ce74ef27a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.531707 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5611cf2-8971-4c1f-9fd2-f12ce74ef27a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-e5611cf2-8971-4c1f-9fd2-f12ce74ef27a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:14.546521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:14.547532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:14.548414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:14.548414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:14.548414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:14.548414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:14.548414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:14.548414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:14.548414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:14.548414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:14.548414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 405/815] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:14.548898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5611cf2-8971-4c1f-9fd2-f12ce74ef27a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.598687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33892661-b88e-4622-8561-f692ac7cf347 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.633851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b290b3-0b90-41c4-9744-951e47f6a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.634646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b290b3-0b90-41c4-9744-951e47f6a467 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.634929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b290b3-0b90-41c4-9744-951e47f6a467 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.635206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b290b3-0b90-41c4-9744-951e47f6a467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.642035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b290b3-0b90-41c4-9744-951e47f6a467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.643476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b290b3-0b90-41c4-9744-951e47f6a467 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.655899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5611cf2-8971-4c1f-9fd2-f12ce74ef27a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-18b290b3-0b90-41c4-9744-951e47f6a467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:14.657703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:14.658763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:14.659689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:14.659689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:14.659689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:14.659689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:14.659689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:14.659689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:14.659689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:14.659689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:14.659689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 411/816] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:14.660175 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b290b3-0b90-41c4-9744-951e47f6a467 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.694080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c87f7-1dd1-4c3e-a2b4-8125333c7182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.694881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c87f7-1dd1-4c3e-a2b4-8125333c7182 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.695171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c87f7-1dd1-4c3e-a2b4-8125333c7182 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.695450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c87f7-1dd1-4c3e-a2b4-8125333c7182 None admin] PATH_INFO: `/v3/services/network` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.696112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c87f7-1dd1-4c3e-a2b4-8125333c7182 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.697523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c87f7-1dd1-4c3e-a2b4-8125333c7182 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-4f7c87f7-1dd1-4c3e-a2b4-8125333c7182 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:14.709407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:14.710540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:14.711357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 406/817] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:14.712153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c87f7-1dd1-4c3e-a2b4-8125333c7182 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.768807 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b290b3-0b90-41c4-9744-951e47f6a467 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.802942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d3fdf-ae3a-4cc0-a100-0c3726144302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.803628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d3fdf-ae3a-4cc0-a100-0c3726144302 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.803909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d3fdf-ae3a-4cc0-a100-0c3726144302 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.804185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d3fdf-ae3a-4cc0-a100-0c3726144302 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.804903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d3fdf-ae3a-4cc0-a100-0c3726144302 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:14.805203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d3fdf-ae3a-4cc0-a100-0c3726144302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.806608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d3fdf-ae3a-4cc0-a100-0c3726144302 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.811213 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 412/818] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:14.812029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d3fdf-ae3a-4cc0-a100-0c3726144302 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.824006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c87f7-1dd1-4c3e-a2b4-8125333c7182 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.857381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619c362-e391-4559-b608-01de0bfdbee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.858136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619c362-e391-4559-b608-01de0bfdbee2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.858428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619c362-e391-4559-b608-01de0bfdbee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.858706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619c362-e391-4559-b608-01de0bfdbee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.872841 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619c362-e391-4559-b608-01de0bfdbee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.874333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619c362-e391-4559-b608-01de0bfdbee2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-e619c362-e391-4559-b608-01de0bfdbee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:14.891593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:14.892587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:14.893511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:14.893511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:14.893511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:14.893511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:14.893511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 407/819] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:14.893798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619c362-e391-4559-b608-01de0bfdbee2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:14.929209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d3fdf-ae3a-4cc0-a100-0c3726144302 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:14.967939 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6353ea-a050-4e20-b0e9-ecc9a70288cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:14.968609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6353ea-a050-4e20-b0e9-ecc9a70288cb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:14.968895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6353ea-a050-4e20-b0e9-ecc9a70288cb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:14.969170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6353ea-a050-4e20-b0e9-ecc9a70288cb None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:14.969988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6353ea-a050-4e20-b0e9-ecc9a70288cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:14.970298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6353ea-a050-4e20-b0e9-ecc9a70288cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:14.971767 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6353ea-a050-4e20-b0e9-ecc9a70288cb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:14.984914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 413/820] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:14.985779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6353ea-a050-4e20-b0e9-ecc9a70288cb None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:15.007711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619c362-e391-4559-b608-01de0bfdbee2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:15.041944 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77107acf-9d74-46b8-8b77-5bdde24933a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:15.042743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77107acf-9d74-46b8-8b77-5bdde24933a7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:15.043032 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77107acf-9d74-46b8-8b77-5bdde24933a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:15.043311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77107acf-9d74-46b8-8b77-5bdde24933a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:15.044109 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77107acf-9d74-46b8-8b77-5bdde24933a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:15.044514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77107acf-9d74-46b8-8b77-5bdde24933a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:15.046028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77107acf-9d74-46b8-8b77-5bdde24933a7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:15.059370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 408/821] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:15.060216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77107acf-9d74-46b8-8b77-5bdde24933a7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:15.087637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6353ea-a050-4e20-b0e9-ecc9a70288cb None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:15.125040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875035b-2d02-4591-9fe5-9c9c2dbecf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:15.125666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875035b-2d02-4591-9fe5-9c9c2dbecf86 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:15.125954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875035b-2d02-4591-9fe5-9c9c2dbecf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:15.126248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875035b-2d02-4591-9fe5-9c9c2dbecf86 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:15.126991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875035b-2d02-4591-9fe5-9c9c2dbecf86 None admin] RBAC: Adding query filter params (name=network) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:15.127298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875035b-2d02-4591-9fe5-9c9c2dbecf86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:15.128676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875035b-2d02-4591-9fe5-9c9c2dbecf86 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:15.133540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 414/822] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:15.134174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875035b-2d02-4591-9fe5-9c9c2dbecf86 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:15.166970 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77107acf-9d74-46b8-8b77-5bdde24933a7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:15.203003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777561f-bcc7-4aca-8989-c1cf31459d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:15.203671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777561f-bcc7-4aca-8989-c1cf31459d40 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:15.203951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777561f-bcc7-4aca-8989-c1cf31459d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:15.204224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777561f-bcc7-4aca-8989-c1cf31459d40 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:15.204935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777561f-bcc7-4aca-8989-c1cf31459d40 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:15.205243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777561f-bcc7-4aca-8989-c1cf31459d40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:15.206637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777561f-bcc7-4aca-8989-c1cf31459d40 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:15.212713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 409/823] 10.222.0.59 () {56 vars in 1124 bytes} [Thu May 12 20:18:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:15.213573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777561f-bcc7-4aca-8989-c1cf31459d40 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:15.240734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875035b-2d02-4591-9fe5-9c9c2dbecf86 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:15.275881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740c587-1c17-48cf-a99e-d8244c59ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:15.276552 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740c587-1c17-48cf-a99e-d8244c59ba2c None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:15.276835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740c587-1c17-48cf-a99e-d8244c59ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:15.277135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740c587-1c17-48cf-a99e-d8244c59ba2c None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:15.277913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740c587-1c17-48cf-a99e-d8244c59ba2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:15.278217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740c587-1c17-48cf-a99e-d8244c59ba2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:15.279621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740c587-1c17-48cf-a99e-d8244c59ba2c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:15.291851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 415/824] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:15.292684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740c587-1c17-48cf-a99e-d8244c59ba2c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:15.315197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777561f-bcc7-4aca-8989-c1cf31459d40 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:15.350084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e4634-01cb-4b38-96e3-77dbc7321729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:15.350988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e4634-01cb-4b38-96e3-77dbc7321729 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:15.351269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e4634-01cb-4b38-96e3-77dbc7321729 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:15.351546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e4634-01cb-4b38-96e3-77dbc7321729 None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/650c0f54ab04442dba1af80d84417da0/roles/5c0bc4258a8348c7afa8b9b712d5cd0b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:15.370041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e4634-01cb-4b38-96e3-77dbc7321729 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=650c0f54ab04442dba1af80d84417da0, role_id=5c0bc4258a8348c7afa8b9b712d5cd0b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:15.371486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e4634-01cb-4b38-96e3-77dbc7321729 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:15.398826 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740c587-1c17-48cf-a99e-d8244c59ba2c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:15.430857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a041c-2e23-484c-946c-66b890fa98e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:15.431524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a041c-2e23-484c-946c-66b890fa98e5 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:15.431814 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a041c-2e23-484c-946c-66b890fa98e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:15.432133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a041c-2e23-484c-946c-66b890fa98e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:15.432969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a041c-2e23-484c-946c-66b890fa98e5 None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=156646eda779439784ddbc7d1fbd5b90) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:15.433302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a041c-2e23-484c-946c-66b890fa98e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:15.434740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a041c-2e23-484c-946c-66b890fa98e5 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:15.440472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 416/825] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:15 2022] GET /identity/v3/role_assignments?user.id=156646eda779439784ddbc7d1fbd5b90&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=4ae0665802b946be870ab06274297a1d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:15.441260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a041c-2e23-484c-946c-66b890fa98e5 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:15.453814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 410/826] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:18:15 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/650c0f54ab04442dba1af80d84417da0/roles/5c0bc4258a8348c7afa8b9b712d5cd0b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:18:15.453814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e4634-01cb-4b38-96e3-77dbc7321729 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:15.578422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e4634-01cb-4b38-96e3-77dbc7321729 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:15.589849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a041c-2e23-484c-946c-66b890fa98e5 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:15.620946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca71c91-b24e-4b94-aa4e-37284dd2aa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:15.621675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca71c91-b24e-4b94-aa4e-37284dd2aa4b None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:15.622235 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca71c91-b24e-4b94-aa4e-37284dd2aa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:15.622528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca71c91-b24e-4b94-aa4e-37284dd2aa4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:15.623315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca71c91-b24e-4b94-aa4e-37284dd2aa4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:15.624765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca71c91-b24e-4b94-aa4e-37284dd2aa4b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:15.631768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19916-1664-4272-ab82-14de9b6a3bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:15.632578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19916-1664-4272-ab82-14de9b6a3bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:15.632942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19916-1664-4272-ab82-14de9b6a3bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:15.633320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19916-1664-4272-ab82-14de9b6a3bb4 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:15.634165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f19916-1664-4272-ab82-14de9b6a3bb4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:15.634554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f19916-1664-4272-ab82-14de9b6a3bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:15.636179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f19916-1664-4272-ab82-14de9b6a3bb4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:15.642480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 417/827] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:15.643503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19916-1664-4272-ab82-14de9b6a3bb4 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:15.764855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19916-1664-4272-ab82-14de9b6a3bb4 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:15.798956 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33ade0-5c24-4696-ae9f-f117c65d5df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:15.799759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33ade0-5c24-4696-ae9f-f117c65d5df2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:15.800045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33ade0-5c24-4696-ae9f-f117c65d5df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:15.800322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33ade0-5c24-4696-ae9f-f117c65d5df2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:15.808342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33ade0-5c24-4696-ae9f-f117c65d5df2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:15.809847 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33ade0-5c24-4696-ae9f-f117c65d5df2 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-ec33ade0-5c24-4696-ae9f-f117c65d5df2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:15.826749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:15.828606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:15.831122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:15.831122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:15.831122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:15.831122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:15.831122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:15.831122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:15.831122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:15.831122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:15.831122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 418/828] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:15.831122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33ade0-5c24-4696-ae9f-f117c65d5df2 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:15.883733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 411/829] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 12 20:18:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:15.893430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca71c91-b24e-4b94-aa4e-37284dd2aa4b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:15.955016 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33ade0-5c24-4696-ae9f-f117c65d5df2 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:15.998590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e735b71-8222-4b81-ae27-db55acf3a5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:15.999274 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e735b71-8222-4b81-ae27-db55acf3a5b0 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:15.999566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e735b71-8222-4b81-ae27-db55acf3a5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:15.999845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e735b71-8222-4b81-ae27-db55acf3a5b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:16.000614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e735b71-8222-4b81-ae27-db55acf3a5b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:16.002070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e735b71-8222-4b81-ae27-db55acf3a5b0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:16.060291 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca71c91-b24e-4b94-aa4e-37284dd2aa4b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:16.112739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc575f-8b5d-42f6-826e-54d7dd2f460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:16.113908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc575f-8b5d-42f6-826e-54d7dd2f460d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:16.114413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc575f-8b5d-42f6-826e-54d7dd2f460d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:16.115737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc575f-8b5d-42f6-826e-54d7dd2f460d None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:16.117147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc575f-8b5d-42f6-826e-54d7dd2f460d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:16.117741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc575f-8b5d-42f6-826e-54d7dd2f460d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:16.119808 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc575f-8b5d-42f6-826e-54d7dd2f460d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:16.130875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 419/830] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 12 20:18:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:16.141517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 412/831] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:16.147880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e735b71-8222-4b81-ae27-db55acf3a5b0 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:16.279278 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e735b71-8222-4b81-ae27-db55acf3a5b0 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:16.327608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996330b-5b7e-4758-9c7e-1ae5e7641fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:16.328996 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996330b-5b7e-4758-9c7e-1ae5e7641fc8 None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:16.329507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996330b-5b7e-4758-9c7e-1ae5e7641fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:16.329973 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996330b-5b7e-4758-9c7e-1ae5e7641fc8 None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/766497e7e0614adea5769b05f0c1cdcf/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:16.335705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996330b-5b7e-4758-9c7e-1ae5e7641fc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=766497e7e0614adea5769b05f0c1cdcf, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:16.337203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996330b-5b7e-4758-9c7e-1ae5e7641fc8 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:16.428736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 420/832] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:18:16 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/766497e7e0614adea5769b05f0c1cdcf/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:18:17.908307 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7adf0c-9da8-412c-9711-a87cec9040e2 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:17.908854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7adf0c-9da8-412c-9711-a87cec9040e2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:17.908854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7adf0c-9da8-412c-9711-a87cec9040e2 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:17.909410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeb665-8bf2-43fc-8b94-a872645f96f8 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:17.909801 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeb665-8bf2-43fc-8b94-a872645f96f8 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:17.910030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfeb665-8bf2-43fc-8b94-a872645f96f8 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:17.910530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 413/833] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:17.911627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 421/834] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:17.916210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ff8e5-7ee7-432f-985f-610c02dbac65 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:17.916501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ff8e5-7ee7-432f-985f-610c02dbac65 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:17.916740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c42ea-11ea-47cc-85d3-677d4c3b67b7 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:17.916844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ff8e5-7ee7-432f-985f-610c02dbac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:17.917046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c42ea-11ea-47cc-85d3-677d4c3b67b7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:17.917327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c42ea-11ea-47cc-85d3-677d4c3b67b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:17.935171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-fb5c42ea-11ea-47cc-85d3-677d4c3b67b7 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:17.936368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-fb5c42ea-11ea-47cc-85d3-677d4c3b67b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:17.941857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-893ff8e5-7ee7-432f-985f-610c02dbac65 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:17.944453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-893ff8e5-7ee7-432f-985f-610c02dbac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:18.007783 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 422/835] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:18.031065 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c42ea-11ea-47cc-85d3-677d4c3b67b7 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:18.038752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 414/836] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:18.061070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ff8e5-7ee7-432f-985f-610c02dbac65 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:18.132980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c42ea-11ea-47cc-85d3-677d4c3b67b7 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:18.163161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ff8e5-7ee7-432f-985f-610c02dbac65 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:18.168341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72403b7c-83a9-441a-9384-f31246535aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:18.169159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72403b7c-83a9-441a-9384-f31246535aaf None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.169475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72403b7c-83a9-441a-9384-f31246535aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.169758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72403b7c-83a9-441a-9384-f31246535aaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.180953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72403b7c-83a9-441a-9384-f31246535aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-72403b7c-83a9-441a-9384-f31246535aaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:18.188979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:18.190032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:18.191896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 423/837] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:18:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:18.196255 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72403b7c-83a9-441a-9384-f31246535aaf None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:18.199864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa4833-af42-4ce1-88a7-d86d4cd996ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:18.200944 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa4833-af42-4ce1-88a7-d86d4cd996ca None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.201459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa4833-af42-4ce1-88a7-d86d4cd996ca None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.201950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa4833-af42-4ce1-88a7-d86d4cd996ca None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.202813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa4833-af42-4ce1-88a7-d86d4cd996ca None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:18.204404 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa4833-af42-4ce1-88a7-d86d4cd996ca None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-87fa4833-af42-4ce1-88a7-d86d4cd996ca None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:18.218072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:18.219120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 20:18:18.219954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:18.227365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 415/838] 10.222.0.59 () {56 vars in 1132 bytes} [Thu May 12 20:18:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:18.229556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa4833-af42-4ce1-88a7-d86d4cd996ca None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:18.311541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72403b7c-83a9-441a-9384-f31246535aaf None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:18.338558 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa4833-af42-4ce1-88a7-d86d4cd996ca None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:18.350992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645d3f-b6a2-438a-9360-71aa0f1cddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:18.351782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645d3f-b6a2-438a-9360-71aa0f1cddb8 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.351960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645d3f-b6a2-438a-9360-71aa0f1cddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.352264 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645d3f-b6a2-438a-9360-71aa0f1cddb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.353052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645d3f-b6a2-438a-9360-71aa0f1cddb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:18.353392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645d3f-b6a2-438a-9360-71aa0f1cddb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:18.354849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645d3f-b6a2-438a-9360-71aa0f1cddb8 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:18.369258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 424/839] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:18:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:18.370333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645d3f-b6a2-438a-9360-71aa0f1cddb8 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:18.377444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a7d65-d0ab-4be5-ae89-44fe5ff2539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:18.378441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a7d65-d0ab-4be5-ae89-44fe5ff2539b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.378920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a7d65-d0ab-4be5-ae89-44fe5ff2539b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.379389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a7d65-d0ab-4be5-ae89-44fe5ff2539b None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.380339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a7d65-d0ab-4be5-ae89-44fe5ff2539b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:18.380837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a7d65-d0ab-4be5-ae89-44fe5ff2539b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:18.382449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a7d65-d0ab-4be5-ae89-44fe5ff2539b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:18.392418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 416/840] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:18.393663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a7d65-d0ab-4be5-ae89-44fe5ff2539b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:18.476668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645d3f-b6a2-438a-9360-71aa0f1cddb8 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:18.498627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a7d65-d0ab-4be5-ae89-44fe5ff2539b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:18.517079 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b44eb-8971-4ab4-bb73-953c9ae39c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:18.517923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b44eb-8971-4ab4-bb73-953c9ae39c53 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.518500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b44eb-8971-4ab4-bb73-953c9ae39c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.518784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b44eb-8971-4ab4-bb73-953c9ae39c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.532783 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b44eb-8971-4ab4-bb73-953c9ae39c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:18.534274 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b44eb-8971-4ab4-bb73-953c9ae39c53 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:18.537160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dcdd7-4ef4-415b-aef0-60f7dec1a836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:18.537919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dcdd7-4ef4-415b-aef0-60f7dec1a836 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.538210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dcdd7-4ef4-415b-aef0-60f7dec1a836 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.538494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dcdd7-4ef4-415b-aef0-60f7dec1a836 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.539215 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dcdd7-4ef4-415b-aef0-60f7dec1a836 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:18.539528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dcdd7-4ef4-415b-aef0-60f7dec1a836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:18.540894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dcdd7-4ef4-415b-aef0-60f7dec1a836 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:18.545685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 417/841] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:18.547151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de8d6-49cc-42d6-9bc5-55f879aabf04 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.547442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de8d6-49cc-42d6-9bc5-55f879aabf04 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.547722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de8d6-49cc-42d6-9bc5-55f879aabf04 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.549156 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 418/842] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:18.561088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9f9be-ef41-41b3-be33-5dcbf273953a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.561088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9f9be-ef41-41b3-be33-5dcbf273953a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.561088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9f9be-ef41-41b3-be33-5dcbf273953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-669b44eb-8971-4ab4-bb73-953c9ae39c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:18.562493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:18.563383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:18.564269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:18.564269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:18.564269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:18.564269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:18.564269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 425/843] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:18.568919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b44eb-8971-4ab4-bb73-953c9ae39c53 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:18.582875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-17b9f9be-ef41-41b3-be33-5dcbf273953a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:18.584577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-17b9f9be-ef41-41b3-be33-5dcbf273953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:18.676499 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 419/844] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:18.703541 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9f9be-ef41-41b3-be33-5dcbf273953a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:18.722227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b44eb-8971-4ab4-bb73-953c9ae39c53 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:18.763614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a757e5-4e93-46f9-93ff-b543032b7864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:18.764413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a757e5-4e93-46f9-93ff-b543032b7864 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.764651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a757e5-4e93-46f9-93ff-b543032b7864 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.764941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a757e5-4e93-46f9-93ff-b543032b7864 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.765963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a757e5-4e93-46f9-93ff-b543032b7864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:18.766422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a757e5-4e93-46f9-93ff-b543032b7864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:18.768514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a757e5-4e93-46f9-93ff-b543032b7864 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:18.783074 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 426/845] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:18.790164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a757e5-4e93-46f9-93ff-b543032b7864 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:18.823480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9f9be-ef41-41b3-be33-5dcbf273953a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:18.870565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89852b1-9b66-465b-8342-b04dd50def70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:18.871374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89852b1-9b66-465b-8342-b04dd50def70 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.871659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89852b1-9b66-465b-8342-b04dd50def70 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.871939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89852b1-9b66-465b-8342-b04dd50def70 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.872598 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89852b1-9b66-465b-8342-b04dd50def70 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:18.873997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89852b1-9b66-465b-8342-b04dd50def70 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b89852b1-9b66-465b-8342-b04dd50def70 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:18.887705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:18.888739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 20:18:18.889608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:18.890348 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 420/846] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:18:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:18.892050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f6318-38d1-4f5a-9157-0016a692d9f0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.892560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f6318-38d1-4f5a-9157-0016a692d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.893056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f6318-38d1-4f5a-9157-0016a692d9f0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.897320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 421/847] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:18.897893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f6318-38d1-4f5a-9157-0016a692d9f0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:18.907070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a757e5-4e93-46f9-93ff-b543032b7864 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:18.944132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cfe98-af91-4463-ac23-8e791352c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:18.945136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cfe98-af91-4463-ac23-8e791352c5cd None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.945136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cfe98-af91-4463-ac23-8e791352c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.945690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cfe98-af91-4463-ac23-8e791352c5cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.953007 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cfe98-af91-4463-ac23-8e791352c5cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:18.954583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cfe98-af91-4463-ac23-8e791352c5cd None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-098cfe98-af91-4463-ac23-8e791352c5cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:18.972853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:18.974509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 427/848] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 12 20:18:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08942547-564f-4798-a27e-3439c4651a44 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:18.975560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08942547-564f-4798-a27e-3439c4651a44 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:18.978566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08942547-564f-4798-a27e-3439c4651a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:18.991524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-08942547-564f-4798-a27e-3439c4651a44 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:18.992707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-08942547-564f-4798-a27e-3439c4651a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:19.040265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f6318-38d1-4f5a-9157-0016a692d9f0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:19.073710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 428/849] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:19.073710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08942547-564f-4798-a27e-3439c4651a44 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:19.081574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765ee9-16e6-49ad-8814-b6d2ca4e1350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:19.082388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765ee9-16e6-49ad-8814-b6d2ca4e1350 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:19.082779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765ee9-16e6-49ad-8814-b6d2ca4e1350 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:19.083222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37765ee9-16e6-49ad-8814-b6d2ca4e1350 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:19.084547 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37765ee9-16e6-49ad-8814-b6d2ca4e1350 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:19.084963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37765ee9-16e6-49ad-8814-b6d2ca4e1350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:19.086455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37765ee9-16e6-49ad-8814-b6d2ca4e1350 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:19.097158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 422/850] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:18:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:19.097158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765ee9-16e6-49ad-8814-b6d2ca4e1350 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:19.180860 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08942547-564f-4798-a27e-3439c4651a44 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:19.201685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37765ee9-16e6-49ad-8814-b6d2ca4e1350 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:19.216251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017e32b-4b67-4ffb-a2cd-c176cc578656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:19.217066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017e32b-4b67-4ffb-a2cd-c176cc578656 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:19.217487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017e32b-4b67-4ffb-a2cd-c176cc578656 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:19.217877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017e32b-4b67-4ffb-a2cd-c176cc578656 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:19.218823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017e32b-4b67-4ffb-a2cd-c176cc578656 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:19.219239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017e32b-4b67-4ffb-a2cd-c176cc578656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:19.220772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017e32b-4b67-4ffb-a2cd-c176cc578656 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:19.246677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 429/851] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 12 20:18:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:19.246677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017e32b-4b67-4ffb-a2cd-c176cc578656 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:19.256623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d820944-705e-4eba-b48c-107796e284fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:19.257470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820944-705e-4eba-b48c-107796e284fc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:19.257784 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820944-705e-4eba-b48c-107796e284fc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:19.258046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820944-705e-4eba-b48c-107796e284fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:19.268790 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d820944-705e-4eba-b48c-107796e284fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-0d820944-705e-4eba-b48c-107796e284fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:19.277086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:19.278242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:19.279347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:19.281586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 423/852] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:19.282437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d820944-705e-4eba-b48c-107796e284fc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:19.345660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017e32b-4b67-4ffb-a2cd-c176cc578656 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:19.380854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338f5c-64fc-4362-a314-70fcc1bd723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:19.381774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338f5c-64fc-4362-a314-70fcc1bd723d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:19.382165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338f5c-64fc-4362-a314-70fcc1bd723d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:19.382544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338f5c-64fc-4362-a314-70fcc1bd723d None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:19.383363 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62338f5c-64fc-4362-a314-70fcc1bd723d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:19.383471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d820944-705e-4eba-b48c-107796e284fc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:19.383851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62338f5c-64fc-4362-a314-70fcc1bd723d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:19.385388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62338f5c-64fc-4362-a314-70fcc1bd723d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:19.401455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 430/853] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:18:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:19.401455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338f5c-64fc-4362-a314-70fcc1bd723d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:19.432691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741a9ab-78ad-40ee-8b41-3ad160407551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:19.433871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741a9ab-78ad-40ee-8b41-3ad160407551 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:19.434372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741a9ab-78ad-40ee-8b41-3ad160407551 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:19.434946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741a9ab-78ad-40ee-8b41-3ad160407551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:19.528952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741a9ab-78ad-40ee-8b41-3ad160407551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:19.531043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741a9ab-78ad-40ee-8b41-3ad160407551 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:19.539214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338f5c-64fc-4362-a314-70fcc1bd723d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:19.601698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be55620-a957-435e-a65b-cc60a58233e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:19.602645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be55620-a957-435e-a65b-cc60a58233e3 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:19.603096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be55620-a957-435e-a65b-cc60a58233e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:19.603543 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be55620-a957-435e-a65b-cc60a58233e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:19.604300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be55620-a957-435e-a65b-cc60a58233e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:19.605253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be55620-a957-435e-a65b-cc60a58233e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:19.606004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be55620-a957-435e-a65b-cc60a58233e3 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:19.616474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 431/854] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:19.622504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be55620-a957-435e-a65b-cc60a58233e3 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:19.681813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 424/855] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:18:19.690145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741a9ab-78ad-40ee-8b41-3ad160407551 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:19.763179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be55620-a957-435e-a65b-cc60a58233e3 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:19.798330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9fc7d-9002-49a7-bf32-3a206005799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:19.799006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9fc7d-9002-49a7-bf32-3a206005799e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:19.799294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9fc7d-9002-49a7-bf32-3a206005799e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:19.799574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9fc7d-9002-49a7-bf32-3a206005799e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:19.815124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9fc7d-9002-49a7-bf32-3a206005799e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:19.816592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9fc7d-9002-49a7-bf32-3a206005799e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:19.820496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741a9ab-78ad-40ee-8b41-3ad160407551 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-d7b9fc7d-9002-49a7-bf32-3a206005799e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:19.835106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:19.836234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:19.837340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:19.837340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:19.837340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:19.837340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:19.837340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 432/856] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:19.845414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9fc7d-9002-49a7-bf32-3a206005799e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:19.874329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e73d2-ce60-43c1-81ca-9ab834e934b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:19.875648 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e73d2-ce60-43c1-81ca-9ab834e934b7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:19.876119 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e73d2-ce60-43c1-81ca-9ab834e934b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:19.876552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e73d2-ce60-43c1-81ca-9ab834e934b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:19.891533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e73d2-ce60-43c1-81ca-9ab834e934b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:19.893249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e73d2-ce60-43c1-81ca-9ab834e934b7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-710e73d2-ce60-43c1-81ca-9ab834e934b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:19.917326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:19.918494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:19.919608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:19.919608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:19.919608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:19.919608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:19.921507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 425/857] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:19.927517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e73d2-ce60-43c1-81ca-9ab834e934b7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:19.965483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9fc7d-9002-49a7-bf32-3a206005799e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:20.000433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fb687-0a44-4e33-927a-d469f7cfc4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:20.007339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fb687-0a44-4e33-927a-d469f7cfc4dc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.007339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fb687-0a44-4e33-927a-d469f7cfc4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.007339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fb687-0a44-4e33-927a-d469f7cfc4dc None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.007339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fb687-0a44-4e33-927a-d469f7cfc4dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:20.007339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fb687-0a44-4e33-927a-d469f7cfc4dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:20.007339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fb687-0a44-4e33-927a-d469f7cfc4dc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:20.022315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 433/858] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:20.023844 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fb687-0a44-4e33-927a-d469f7cfc4dc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:20.043028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e73d2-ce60-43c1-81ca-9ab834e934b7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:20.085350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f9e5-4cee-44c1-a325-1ca84fb6b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:20.086362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f9e5-4cee-44c1-a325-1ca84fb6b678 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.086872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f9e5-4cee-44c1-a325-1ca84fb6b678 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.087357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f9e5-4cee-44c1-a325-1ca84fb6b678 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.088299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f9e5-4cee-44c1-a325-1ca84fb6b678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:20.088836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f9e5-4cee-44c1-a325-1ca84fb6b678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:20.090459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f9e5-4cee-44c1-a325-1ca84fb6b678 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:20.103484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 426/859] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:20.114069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f9e5-4cee-44c1-a325-1ca84fb6b678 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:20.140435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fb687-0a44-4e33-927a-d469f7cfc4dc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:20.188501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836cda-4251-410a-9778-65def21b5845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:20.189668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836cda-4251-410a-9778-65def21b5845 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.190293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836cda-4251-410a-9778-65def21b5845 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.190584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836cda-4251-410a-9778-65def21b5845 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.200158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b836cda-4251-410a-9778-65def21b5845 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:20.202091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b836cda-4251-410a-9778-65def21b5845 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:20.212745 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f9e5-4cee-44c1-a325-1ca84fb6b678 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-9b836cda-4251-410a-9778-65def21b5845 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:20.221803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:20.222785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:20.223845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:20.223845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:20.223845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:20.223845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:20.223845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:20.223845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:20.223845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:20.223845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:20.223845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 20:18:20.223845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:20.224393 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 434/860] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:20.234267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836cda-4251-410a-9778-65def21b5845 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:20.250305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0851310-f080-40c6-a21e-eb87eb12ad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:20.251109 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0851310-f080-40c6-a21e-eb87eb12ad6d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.251389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0851310-f080-40c6-a21e-eb87eb12ad6d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.251767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0851310-f080-40c6-a21e-eb87eb12ad6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.260548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0851310-f080-40c6-a21e-eb87eb12ad6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:20.262046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0851310-f080-40c6-a21e-eb87eb12ad6d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c0851310-f080-40c6-a21e-eb87eb12ad6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:20.276838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:20.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:20.281227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:20.281227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:20.281227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:20.281227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:20.281227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:20.281227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:20.281227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:20.281227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:20.285321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 427/861] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:20.285321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0851310-f080-40c6-a21e-eb87eb12ad6d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:20.347176 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836cda-4251-410a-9778-65def21b5845 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:20.388640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee85b5-d41d-40b9-82a6-4afae6c2ec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:20.389404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee85b5-d41d-40b9-82a6-4afae6c2ec48 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.389694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee85b5-d41d-40b9-82a6-4afae6c2ec48 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.389991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee85b5-d41d-40b9-82a6-4afae6c2ec48 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.390928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee85b5-d41d-40b9-82a6-4afae6c2ec48 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:20.391247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee85b5-d41d-40b9-82a6-4afae6c2ec48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:20.392687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee85b5-d41d-40b9-82a6-4afae6c2ec48 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:20.411019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 435/862] 10.222.0.59 () {56 vars in 1135 bytes} [Thu May 12 20:18:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:20.418327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee85b5-d41d-40b9-82a6-4afae6c2ec48 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:20.420532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0851310-f080-40c6-a21e-eb87eb12ad6d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:20.463324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a720-b0d4-4910-a162-039220e5a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:20.464835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a720-b0d4-4910-a162-039220e5a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.465190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a720-b0d4-4910-a162-039220e5a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.465569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a720-b0d4-4910-a162-039220e5a7a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.466448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a720-b0d4-4910-a162-039220e5a7a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:20.466826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a720-b0d4-4910-a162-039220e5a7a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:20.468327 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a720-b0d4-4910-a162-039220e5a7a9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:20.489567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 428/863] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:20.492680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a720-b0d4-4910-a162-039220e5a7a9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:20.572849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee85b5-d41d-40b9-82a6-4afae6c2ec48 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:20.607165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a720-b0d4-4910-a162-039220e5a7a9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:20.620471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eebd0-2c5c-4a2a-9969-043154fc166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:20.621775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eebd0-2c5c-4a2a-9969-043154fc166f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.622265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eebd0-2c5c-4a2a-9969-043154fc166f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.622731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eebd0-2c5c-4a2a-9969-043154fc166f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.654816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923ec85-8b3c-4752-a13f-8d58cf625625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:20.656289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923ec85-8b3c-4752-a13f-8d58cf625625 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.656826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923ec85-8b3c-4752-a13f-8d58cf625625 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.657291 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923ec85-8b3c-4752-a13f-8d58cf625625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.658783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923ec85-8b3c-4752-a13f-8d58cf625625 None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=650c0f54ab04442dba1af80d84417da0) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:20.659255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923ec85-8b3c-4752-a13f-8d58cf625625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:20.661756 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923ec85-8b3c-4752-a13f-8d58cf625625 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:20.670021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 429/864] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:20 2022] GET /identity/v3/role_assignments?user.id=650c0f54ab04442dba1af80d84417da0&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:20.708871 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eebd0-2c5c-4a2a-9969-043154fc166f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:20.710785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eebd0-2c5c-4a2a-9969-043154fc166f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:20.825675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 436/865] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:18:20.831935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923ec85-8b3c-4752-a13f-8d58cf625625 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:20.925120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fc9ea-11f4-4fe3-a702-e4bc4621deaa None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.925442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fc9ea-11f4-4fe3-a702-e4bc4621deaa None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.925713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fc9ea-11f4-4fe3-a702-e4bc4621deaa None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.927996 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 437/866] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:20.937233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef83aa-230d-4374-b60f-ee38be8248b0 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.937568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef83aa-230d-4374-b60f-ee38be8248b0 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.937851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef83aa-230d-4374-b60f-ee38be8248b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.947153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923ec85-8b3c-4752-a13f-8d58cf625625 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:20.962260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-13ef83aa-230d-4374-b60f-ee38be8248b0 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:20.965302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-13ef83aa-230d-4374-b60f-ee38be8248b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:20.982197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933d8bb-8468-46cf-9ec2-5183887a5924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:20.983513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933d8bb-8468-46cf-9ec2-5183887a5924 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:20.983513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933d8bb-8468-46cf-9ec2-5183887a5924 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:20.983513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933d8bb-8468-46cf-9ec2-5183887a5924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:20.997247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933d8bb-8468-46cf-9ec2-5183887a5924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:21.000433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933d8bb-8468-46cf-9ec2-5183887a5924 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-0933d8bb-8468-46cf-9ec2-5183887a5924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:21.018920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:21.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:21.027024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:21.027024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:21.027024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:21.027024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:21.027024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 430/867] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:21.031845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933d8bb-8468-46cf-9ec2-5183887a5924 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:21.053056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 438/868] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:21.077698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef83aa-230d-4374-b60f-ee38be8248b0 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:21.150354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933d8bb-8468-46cf-9ec2-5183887a5924 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:21.191816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a47dc-061f-4dfe-8d71-937b31205283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:21.193164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a47dc-061f-4dfe-8d71-937b31205283 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:21.193777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a47dc-061f-4dfe-8d71-937b31205283 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:21.193777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a47dc-061f-4dfe-8d71-937b31205283 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:21.194525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a47dc-061f-4dfe-8d71-937b31205283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:21.194827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a47dc-061f-4dfe-8d71-937b31205283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:21.196199 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a47dc-061f-4dfe-8d71-937b31205283 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:21.208622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 431/869] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:21.218332 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a47dc-061f-4dfe-8d71-937b31205283 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:21.223216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef83aa-230d-4374-b60f-ee38be8248b0 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:21.289302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e99d4-1103-4adb-a97e-edc8c03724cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:21.290020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e99d4-1103-4adb-a97e-edc8c03724cb None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:21.290309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e99d4-1103-4adb-a97e-edc8c03724cb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:21.293311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e99d4-1103-4adb-a97e-edc8c03724cb None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:21.293311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e99d4-1103-4adb-a97e-edc8c03724cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:21.295228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e99d4-1103-4adb-a97e-edc8c03724cb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:21.372743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a47dc-061f-4dfe-8d71-937b31205283 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:21.385305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 439/870] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:18:21 2022] POST /identity/v3/services => generated 269 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:18:21.456517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2702-a362-42d0-a112-f2d2f5bceeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:21.457251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2702-a362-42d0-a112-f2d2f5bceeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:21.457602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2702-a362-42d0-a112-f2d2f5bceeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:21.457892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2702-a362-42d0-a112-f2d2f5bceeb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:21.466012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d2702-a362-42d0-a112-f2d2f5bceeb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:21.467512 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d2702-a362-42d0-a112-f2d2f5bceeb4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d03d2702-a362-42d0-a112-f2d2f5bceeb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:21.485462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:21.487722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:21.490574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:21.490574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:21.490574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:21.490574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:21.490574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:21.490574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:21.490574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:21.490574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:21.490574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 432/871] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:21.497302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e99d4-1103-4adb-a97e-edc8c03724cb None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:21.605353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e99d4-1103-4adb-a97e-edc8c03724cb None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:21.653415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8caf5-7229-4ff8-b142-25b7edea9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:21.654105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8caf5-7229-4ff8-b142-25b7edea9a75 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:21.654387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8caf5-7229-4ff8-b142-25b7edea9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:21.654662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8caf5-7229-4ff8-b142-25b7edea9a75 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:21.655471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8caf5-7229-4ff8-b142-25b7edea9a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:21.655780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8caf5-7229-4ff8-b142-25b7edea9a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:21.657359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8caf5-7229-4ff8-b142-25b7edea9a75 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:21.671945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 440/872] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:21.678196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2702-a362-42d0-a112-f2d2f5bceeb4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:21.785345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2702-a362-42d0-a112-f2d2f5bceeb4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:21.823753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae01c14-9bf1-486e-a244-3b966f5c4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:21.824421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae01c14-9bf1-486e-a244-3b966f5c4e83 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:21.824701 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae01c14-9bf1-486e-a244-3b966f5c4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:21.824974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae01c14-9bf1-486e-a244-3b966f5c4e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:21.825844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae01c14-9bf1-486e-a244-3b966f5c4e83 None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=766497e7e0614adea5769b05f0c1cdcf) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:21.826153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae01c14-9bf1-486e-a244-3b966f5c4e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:21.827596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae01c14-9bf1-486e-a244-3b966f5c4e83 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:21.834811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 433/873] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:21 2022] GET /identity/v3/role_assignments?user.id=766497e7e0614adea5769b05f0c1cdcf&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=4ae0665802b946be870ab06274297a1d => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:21.835078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc706154-63a3-42fb-9a9e-1d839d4bd3ff None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:21.835342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc706154-63a3-42fb-9a9e-1d839d4bd3ff None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:21.835628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc706154-63a3-42fb-9a9e-1d839d4bd3ff None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:21.837337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 441/874] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:21.847190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdefaa-eb6e-46cd-99a9-701db91a3da1 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:21.847508 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdefaa-eb6e-46cd-99a9-701db91a3da1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:21.847757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdefaa-eb6e-46cd-99a9-701db91a3da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:21.867325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2cbdefaa-eb6e-46cd-99a9-701db91a3da1 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:21.868558 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2cbdefaa-eb6e-46cd-99a9-701db91a3da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:21.947511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 434/875] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:21 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:21.970028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc706154-63a3-42fb-9a9e-1d839d4bd3ff None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:22.084255 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc706154-63a3-42fb-9a9e-1d839d4bd3ff None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:22.124627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc7008-9be9-4131-ad31-bf9319edce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:22.125324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc7008-9be9-4131-ad31-bf9319edce18 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:22.125614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc7008-9be9-4131-ad31-bf9319edce18 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:22.125891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc7008-9be9-4131-ad31-bf9319edce18 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:22.126692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc7008-9be9-4131-ad31-bf9319edce18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:22.128112 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc7008-9be9-4131-ad31-bf9319edce18 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:22.230414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 442/876] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:18:21 2022] POST /identity/v3/services => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:23.287322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd3646-673e-4a27-9218-d637dc349fa2 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:23.287322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd3646-673e-4a27-9218-d637dc349fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:23.287911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd3646-673e-4a27-9218-d637dc349fa2 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:23.290177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 435/877] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:23.299369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6693c56-0db1-4599-b997-9bb430537f5d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:23.299369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6693c56-0db1-4599-b997-9bb430537f5d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:23.299369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6693c56-0db1-4599-b997-9bb430537f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:23.316011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a6693c56-0db1-4599-b997-9bb430537f5d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:23.318172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a6693c56-0db1-4599-b997-9bb430537f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:23.397506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 443/878] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:23.421776 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd3646-673e-4a27-9218-d637dc349fa2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:23.528032 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd3646-673e-4a27-9218-d637dc349fa2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:23.563660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ffa39-6aa7-4a96-9dc2-051e76e27516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:23.564454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ffa39-6aa7-4a96-9dc2-051e76e27516 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:23.564783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ffa39-6aa7-4a96-9dc2-051e76e27516 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:23.565063 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ffa39-6aa7-4a96-9dc2-051e76e27516 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:23.576160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ffa39-6aa7-4a96-9dc2-051e76e27516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8a6ffa39-6aa7-4a96-9dc2-051e76e27516 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:23.584973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:23.585889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:23.586794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 436/879] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 12 20:18:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:23.592496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6693c56-0db1-4599-b997-9bb430537f5d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:23.714498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6693c56-0db1-4599-b997-9bb430537f5d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:23.749617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05c0ef-f899-4f87-9630-e118c534b705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:23.750295 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05c0ef-f899-4f87-9630-e118c534b705 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:23.750578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05c0ef-f899-4f87-9630-e118c534b705 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:23.750857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05c0ef-f899-4f87-9630-e118c534b705 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:23.751783 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05c0ef-f899-4f87-9630-e118c534b705 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:23.752090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05c0ef-f899-4f87-9630-e118c534b705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:23.753477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05c0ef-f899-4f87-9630-e118c534b705 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:23.762966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 444/880] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 12 20:18:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:23.768448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ffa39-6aa7-4a96-9dc2-051e76e27516 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:23.858524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabcc4a-de1d-400c-b3c1-758bbb1b3bf1 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:23.859191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabcc4a-de1d-400c-b3c1-758bbb1b3bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:23.859664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabcc4a-de1d-400c-b3c1-758bbb1b3bf1 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:23.861483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 445/881] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:23.869163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed306035-2514-4387-994f-0d1176a19a2c None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:23.869704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed306035-2514-4387-994f-0d1176a19a2c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:23.870178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed306035-2514-4387-994f-0d1176a19a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:23.874566 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ffa39-6aa7-4a96-9dc2-051e76e27516 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:23.887922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-ed306035-2514-4387-994f-0d1176a19a2c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:23.889468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ed306035-2514-4387-994f-0d1176a19a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:23.917138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846766-019c-4716-9930-d3f59a964eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:23.918986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846766-019c-4716-9930-d3f59a964eac None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:23.919493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846766-019c-4716-9930-d3f59a964eac None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:23.919984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846766-019c-4716-9930-d3f59a964eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:23.937352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af846766-019c-4716-9930-d3f59a964eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:23.939185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af846766-019c-4716-9930-d3f59a964eac None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-af846766-019c-4716-9930-d3f59a964eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:23.959852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:23.960793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:23.961719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:23.961719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:23.961719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:23.961719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:23.968039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 437/882] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:23.969133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846766-019c-4716-9930-d3f59a964eac None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:23.985581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 446/883] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:24.001720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed306035-2514-4387-994f-0d1176a19a2c None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:24.090233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846766-019c-4716-9930-d3f59a964eac None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:24.113336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed306035-2514-4387-994f-0d1176a19a2c None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:24.131868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e0766-9c70-44cb-aa0b-fd743599cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:24.132551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0766-9c70-44cb-aa0b-fd743599cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.132839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0766-9c70-44cb-aa0b-fd743599cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.133555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0766-9c70-44cb-aa0b-fd743599cdb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.134595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e0766-9c70-44cb-aa0b-fd743599cdb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:24.134909 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e0766-9c70-44cb-aa0b-fd743599cdb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:24.136447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e0766-9c70-44cb-aa0b-fd743599cdb5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:24.159848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 438/884] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:24.160045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee5ed-970c-45a1-9d4c-dd593e918c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:24.161950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee5ed-970c-45a1-9d4c-dd593e918c0e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.162642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee5ed-970c-45a1-9d4c-dd593e918c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.162762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e0766-9c70-44cb-aa0b-fd743599cdb5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:24.163263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee5ed-970c-45a1-9d4c-dd593e918c0e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.164165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ee5ed-970c-45a1-9d4c-dd593e918c0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:24.166107 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ee5ed-970c-45a1-9d4c-dd593e918c0e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-c28ee5ed-970c-45a1-9d4c-dd593e918c0e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:24.183512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:24.184522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 20:18:24.185392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:24.192235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 447/885] 10.222.0.59 () {56 vars in 1132 bytes} [Thu May 12 20:18:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:24.194422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee5ed-970c-45a1-9d4c-dd593e918c0e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:24.285311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e0766-9c70-44cb-aa0b-fd743599cdb5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:24.307791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee5ed-970c-45a1-9d4c-dd593e918c0e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:24.323742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109922d1-d3b7-469c-b303-533e95f5e651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:24.325606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109922d1-d3b7-469c-b303-533e95f5e651 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.326124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109922d1-d3b7-469c-b303-533e95f5e651 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.326599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109922d1-d3b7-469c-b303-533e95f5e651 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.336189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109922d1-d3b7-469c-b303-533e95f5e651 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:24.338131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109922d1-d3b7-469c-b303-533e95f5e651 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:24.350215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605ee6f-92f0-489a-8434-764db5ed1166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:24.351275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605ee6f-92f0-489a-8434-764db5ed1166 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.351559 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605ee6f-92f0-489a-8434-764db5ed1166 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.351834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605ee6f-92f0-489a-8434-764db5ed1166 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.352630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605ee6f-92f0-489a-8434-764db5ed1166 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:24.352939 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605ee6f-92f0-489a-8434-764db5ed1166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:24.354469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605ee6f-92f0-489a-8434-764db5ed1166 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-109922d1-d3b7-469c-b303-533e95f5e651 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:24.357320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:24.358311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:24.359258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:24.359258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:24.359258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:24.359258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:24.359258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:24.359258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:24.359258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:24.359258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:24.359258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:24.359258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:24.367295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 439/887] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 12 20:18:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:24.367479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 448/887] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:24.369109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605ee6f-92f0-489a-8434-764db5ed1166 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:24.369753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109922d1-d3b7-469c-b303-533e95f5e651 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:24.481666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605ee6f-92f0-489a-8434-764db5ed1166 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:24.490166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109922d1-d3b7-469c-b303-533e95f5e651 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:24.518455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa8e4b-55c7-4cfc-b624-8051a703ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:24.519112 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa8e4b-55c7-4cfc-b624-8051a703ee67 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.519399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa8e4b-55c7-4cfc-b624-8051a703ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.519669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa8e4b-55c7-4cfc-b624-8051a703ee67 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.520424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa8e4b-55c7-4cfc-b624-8051a703ee67 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:24.521836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa8e4b-55c7-4cfc-b624-8051a703ee67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:24.523294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa8e4b-55c7-4cfc-b624-8051a703ee67 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:24.528778 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 449/888] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:24.529882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81aca9-6bf6-4e2f-a4cb-146a04f21d9b None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.530342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81aca9-6bf6-4e2f-a4cb-146a04f21d9b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.530771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81aca9-6bf6-4e2f-a4cb-146a04f21d9b None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.532163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 450/889] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:24.534142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81aca9-6bf6-4e2f-a4cb-146a04f21d9b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:24.538354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568494b-3a58-4463-bd11-f56bcd3fd2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:24.539057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568494b-3a58-4463-bd11-f56bcd3fd2be None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.539347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568494b-3a58-4463-bd11-f56bcd3fd2be None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.539632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568494b-3a58-4463-bd11-f56bcd3fd2be None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.540493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568494b-3a58-4463-bd11-f56bcd3fd2be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:24.540810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568494b-3a58-4463-bd11-f56bcd3fd2be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:24.542467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568494b-3a58-4463-bd11-f56bcd3fd2be None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:24.564685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 440/890] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 12 20:18:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:24.564685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ffe6f-079d-4995-8559-052e69ea12cd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.564685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ffe6f-079d-4995-8559-052e69ea12cd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.564685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ffe6f-079d-4995-8559-052e69ea12cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.578649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ee6ffe6f-079d-4995-8559-052e69ea12cd None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:24.579854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ee6ffe6f-079d-4995-8559-052e69ea12cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:24.636459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81aca9-6bf6-4e2f-a4cb-146a04f21d9b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:24.647459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 441/891] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:24.648805 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bdcd8-0ef0-437f-ace0-e51f13a2cb9e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.649101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bdcd8-0ef0-437f-ace0-e51f13a2cb9e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.649405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bdcd8-0ef0-437f-ace0-e51f13a2cb9e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.650803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 442/892] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:24.651348 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bdcd8-0ef0-437f-ace0-e51f13a2cb9e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:24.673801 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ed3d9-3965-445d-a758-ce8a11d5dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:24.674560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed3d9-3965-445d-a758-ce8a11d5dd89 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.674853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed3d9-3965-445d-a758-ce8a11d5dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.675149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed3d9-3965-445d-a758-ce8a11d5dd89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.675958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ed3d9-3965-445d-a758-ce8a11d5dd89 None admin] RBAC: Adding query filter params (interface=public, service_id=2e95627507ed41518cbcf5889fc97fd0, region_id=RegionOne) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:24.676272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ed3d9-3965-445d-a758-ce8a11d5dd89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:24.678306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ed3d9-3965-445d-a758-ce8a11d5dd89 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:24.683536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 451/893] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 12 20:18:24 2022] GET /identity/v3/endpoints?service_id=2e95627507ed41518cbcf5889fc97fd0&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:24.684843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b9e71-0557-453a-a6e7-f1c876c5e874 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.685138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b9e71-0557-453a-a6e7-f1c876c5e874 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.685454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b9e71-0557-453a-a6e7-f1c876c5e874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.702835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-cf9b9e71-0557-453a-a6e7-f1c876c5e874 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:24.704577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-cf9b9e71-0557-453a-a6e7-f1c876c5e874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:24.758803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bdcd8-0ef0-437f-ace0-e51f13a2cb9e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:24.776110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 452/894] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:24.776969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b9e71-0557-453a-a6e7-f1c876c5e874 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:24.790789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77145209-f9bd-4d3a-b517-1f8789cbab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:24.791447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77145209-f9bd-4d3a-b517-1f8789cbab28 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.791734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77145209-f9bd-4d3a-b517-1f8789cbab28 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.792012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77145209-f9bd-4d3a-b517-1f8789cbab28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.858780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77145209-f9bd-4d3a-b517-1f8789cbab28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:24.860265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77145209-f9bd-4d3a-b517-1f8789cbab28 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:24.887147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b9e71-0557-453a-a6e7-f1c876c5e874 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:24.924029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea5bb1-ad4c-44a2-bbf3-64b366e5d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:24.924846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea5bb1-ad4c-44a2-bbf3-64b366e5d2fc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:24.925130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea5bb1-ad4c-44a2-bbf3-64b366e5d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:24.925425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea5bb1-ad4c-44a2-bbf3-64b366e5d2fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:24.926086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea5bb1-ad4c-44a2-bbf3-64b366e5d2fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:24.928143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea5bb1-ad4c-44a2-bbf3-64b366e5d2fc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-12ea5bb1-ad4c-44a2-bbf3-64b366e5d2fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:24.949300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:24.950376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:24.951210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 453/895] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:24.952522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea5bb1-ad4c-44a2-bbf3-64b366e5d2fc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:24.967076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 443/896] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:24 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:18:24.967076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77145209-f9bd-4d3a-b517-1f8789cbab28 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.064346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea5bb1-ad4c-44a2-bbf3-64b366e5d2fc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.065666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77145209-f9bd-4d3a-b517-1f8789cbab28 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.096844 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0252bba-6483-473e-ae68-cc409c0c34ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.097538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252bba-6483-473e-ae68-cc409c0c34ed None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.097822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252bba-6483-473e-ae68-cc409c0c34ed None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.098100 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252bba-6483-473e-ae68-cc409c0c34ed None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:25.098344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b5935-b91c-4820-a0de-7bcc7ca8c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.099319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0252bba-6483-473e-ae68-cc409c0c34ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:25.099668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b5935-b91c-4820-a0de-7bcc7ca8c6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.099951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b5935-b91c-4820-a0de-7bcc7ca8c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.100224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b5935-b91c-4820-a0de-7bcc7ca8c6c6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:25.100729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0252bba-6483-473e-ae68-cc409c0c34ed None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:25.100875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b5935-b91c-4820-a0de-7bcc7ca8c6c6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:25.102266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b5935-b91c-4820-a0de-7bcc7ca8c6c6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:25.106388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 454/897] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 12 20:18:24 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:18:25.107351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0252bba-6483-473e-ae68-cc409c0c34ed None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c76b5935-b91c-4820-a0de-7bcc7ca8c6c6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:25.113994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:25.116476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:25.118605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 444/898] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:18:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:25.122394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b5935-b91c-4820-a0de-7bcc7ca8c6c6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.220376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0252bba-6483-473e-ae68-cc409c0c34ed None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.227889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b5935-b91c-4820-a0de-7bcc7ca8c6c6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.258358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91773e7c-3edf-4345-bcbe-561dab7dbbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.259041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91773e7c-3edf-4345-bcbe-561dab7dbbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.259324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91773e7c-3edf-4345-bcbe-561dab7dbbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.259601 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91773e7c-3edf-4345-bcbe-561dab7dbbf0 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:25.260327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91773e7c-3edf-4345-bcbe-561dab7dbbf0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:25.260637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91773e7c-3edf-4345-bcbe-561dab7dbbf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:25.262119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91773e7c-3edf-4345-bcbe-561dab7dbbf0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:25.264911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfdade-3253-4b2b-8f25-ba5ad6cd9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.265757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfdade-3253-4b2b-8f25-ba5ad6cd9ccc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.266040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfdade-3253-4b2b-8f25-ba5ad6cd9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.266315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfdade-3253-4b2b-8f25-ba5ad6cd9ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:25.272354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 455/899] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 12 20:18:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:25.272354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91773e7c-3edf-4345-bcbe-561dab7dbbf0 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.278350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfdade-3253-4b2b-8f25-ba5ad6cd9ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:25.279814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfdade-3253-4b2b-8f25-ba5ad6cd9ccc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-65bfdade-3253-4b2b-8f25-ba5ad6cd9ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:25.298831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:25.299793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:25.300662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:25.300662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:25.300662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:25.300662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:25.300662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 445/900] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:25.300957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfdade-3253-4b2b-8f25-ba5ad6cd9ccc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.383529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91773e7c-3edf-4345-bcbe-561dab7dbbf0 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.407995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfdade-3253-4b2b-8f25-ba5ad6cd9ccc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.420213 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c95ab8-5d9b-46df-b7dd-fa81c502d9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.421326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c95ab8-5d9b-46df-b7dd-fa81c502d9fc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.421833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c95ab8-5d9b-46df-b7dd-fa81c502d9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.422173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c95ab8-5d9b-46df-b7dd-fa81c502d9fc None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:25.422966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c95ab8-5d9b-46df-b7dd-fa81c502d9fc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:25.423340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c95ab8-5d9b-46df-b7dd-fa81c502d9fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:25.424793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c95ab8-5d9b-46df-b7dd-fa81c502d9fc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:25.435596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 456/901] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:18:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:25.435596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c95ab8-5d9b-46df-b7dd-fa81c502d9fc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.445835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007c24-e4c8-4d91-a799-0c0d2d2f2197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.446528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007c24-e4c8-4d91-a799-0c0d2d2f2197 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.446812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007c24-e4c8-4d91-a799-0c0d2d2f2197 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.447089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007c24-e4c8-4d91-a799-0c0d2d2f2197 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:25.447807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a007c24-e4c8-4d91-a799-0c0d2d2f2197 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:25.448111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a007c24-e4c8-4d91-a799-0c0d2d2f2197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:25.449523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a007c24-e4c8-4d91-a799-0c0d2d2f2197 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:25.465619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 446/902] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 12 20:18:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:25.465619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007c24-e4c8-4d91-a799-0c0d2d2f2197 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.550342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c95ab8-5d9b-46df-b7dd-fa81c502d9fc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.600832 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43be11-907f-4628-b0fb-72da8f4d3f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.601561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43be11-907f-4628-b0fb-72da8f4d3f4f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.601849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43be11-907f-4628-b0fb-72da8f4d3f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.602125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43be11-907f-4628-b0fb-72da8f4d3f4f None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:25.602772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a007c24-e4c8-4d91-a799-0c0d2d2f2197 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.602884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43be11-907f-4628-b0fb-72da8f4d3f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:25.603170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43be11-907f-4628-b0fb-72da8f4d3f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:25.604584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43be11-907f-4628-b0fb-72da8f4d3f4f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:25.623755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 457/903] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:25.629179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43be11-907f-4628-b0fb-72da8f4d3f4f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.653866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4f6be-50db-4c1a-8dec-ae0c330def67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.655376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4f6be-50db-4c1a-8dec-ae0c330def67 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.656054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4f6be-50db-4c1a-8dec-ae0c330def67 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.656684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4f6be-50db-4c1a-8dec-ae0c330def67 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:25.658056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4f6be-50db-4c1a-8dec-ae0c330def67 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:25.658777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4f6be-50db-4c1a-8dec-ae0c330def67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:25.661740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4f6be-50db-4c1a-8dec-ae0c330def67 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:25.670541 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 447/904] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:18:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:25.677662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4f6be-50db-4c1a-8dec-ae0c330def67 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.755904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43be11-907f-4628-b0fb-72da8f4d3f4f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.793847 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b4c52-58b9-4935-b690-215cc47e74b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.795346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b4c52-58b9-4935-b690-215cc47e74b2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.795927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b4c52-58b9-4935-b690-215cc47e74b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.796605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b4c52-58b9-4935-b690-215cc47e74b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:25.806255 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b4c52-58b9-4935-b690-215cc47e74b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:25.807918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b4c52-58b9-4935-b690-215cc47e74b2 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:25.816477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4f6be-50db-4c1a-8dec-ae0c330def67 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-dc9b4c52-58b9-4935-b690-215cc47e74b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:25.823006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:25.824091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:25.825101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:25.825101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:25.825101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:25.825101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:25.825101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:25.825101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:25.825101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:25.825101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:25.827212 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 458/905] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:25.832753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b4c52-58b9-4935-b690-215cc47e74b2 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.853615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de90cb-043c-448a-840f-82cc41b798c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.854649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de90cb-043c-448a-840f-82cc41b798c1 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.855140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de90cb-043c-448a-840f-82cc41b798c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.855603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de90cb-043c-448a-840f-82cc41b798c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:25.856583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de90cb-043c-448a-840f-82cc41b798c1 None admin] RBAC: Adding query filter params (interface=public, service_id=a765fd380f314db7872b4f5b9860378e, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:25.857088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de90cb-043c-448a-840f-82cc41b798c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:25.861579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de90cb-043c-448a-840f-82cc41b798c1 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:25.868511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 448/906] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 12 20:18:25 2022] GET /identity/v3/endpoints?service_id=a765fd380f314db7872b4f5b9860378e&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:25.874127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de90cb-043c-448a-840f-82cc41b798c1 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:25.958736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b4c52-58b9-4935-b690-215cc47e74b2 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:25.996684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611511e2-c8c9-4015-aeca-5e9f259bbd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:25.997669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611511e2-c8c9-4015-aeca-5e9f259bbd60 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:25.998273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611511e2-c8c9-4015-aeca-5e9f259bbd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:25.999054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611511e2-c8c9-4015-aeca-5e9f259bbd60 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:26.000373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611511e2-c8c9-4015-aeca-5e9f259bbd60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:26.000867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611511e2-c8c9-4015-aeca-5e9f259bbd60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:26.001903 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de90cb-043c-448a-840f-82cc41b798c1 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:26.002728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611511e2-c8c9-4015-aeca-5e9f259bbd60 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:26.023769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 459/907] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:26.024682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611511e2-c8c9-4015-aeca-5e9f259bbd60 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:26.049509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377606ae-2002-432d-83f3-08668a685e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:26.050587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377606ae-2002-432d-83f3-08668a685e67 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:26.051080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377606ae-2002-432d-83f3-08668a685e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:26.052146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377606ae-2002-432d-83f3-08668a685e67 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:26.053192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377606ae-2002-432d-83f3-08668a685e67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:26.054977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377606ae-2002-432d-83f3-08668a685e67 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:26.061823 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 449/908] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 12 20:18:25 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:18:26.145474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611511e2-c8c9-4015-aeca-5e9f259bbd60 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:26.183965 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b31d6a-bdd6-4ca2-bf60-fddf8a4a31ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:26.184633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b31d6a-bdd6-4ca2-bf60-fddf8a4a31ea None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:26.184919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b31d6a-bdd6-4ca2-bf60-fddf8a4a31ea None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:26.185196 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b31d6a-bdd6-4ca2-bf60-fddf8a4a31ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:26.186060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b31d6a-bdd6-4ca2-bf60-fddf8a4a31ea None admin] RBAC: Adding query filter params (role.id=36d9055ee9d74c3cb9c5c4c6599dffbd, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=650c0f54ab04442dba1af80d84417da0) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:26.186368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b31d6a-bdd6-4ca2-bf60-fddf8a4a31ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:26.187808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b31d6a-bdd6-4ca2-bf60-fddf8a4a31ea None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:26.194676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 460/909] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:26 2022] GET /identity/v3/role_assignments?user.id=650c0f54ab04442dba1af80d84417da0&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=36d9055ee9d74c3cb9c5c4c6599dffbd => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:27.480729 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafcfe7-5d49-4ec4-811c-2fd9cbcb0a62 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:27.481258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafcfe7-5d49-4ec4-811c-2fd9cbcb0a62 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:27.481372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafcfe7-5d49-4ec4-811c-2fd9cbcb0a62 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:27.483349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 450/910] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:27.489610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a04d2-8dc0-49c5-af14-f42c2ab6c14d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:27.490334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a04d2-8dc0-49c5-af14-f42c2ab6c14d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:27.490334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a04d2-8dc0-49c5-af14-f42c2ab6c14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:27.508287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-e81a04d2-8dc0-49c5-af14-f42c2ab6c14d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:27.509951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e81a04d2-8dc0-49c5-af14-f42c2ab6c14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:27.583321 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 461/911] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:27.624318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafcfe7-5d49-4ec4-811c-2fd9cbcb0a62 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:27.762340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafcfe7-5d49-4ec4-811c-2fd9cbcb0a62 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:27.804924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385db8-9703-4a10-806e-853728d4e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:27.806173 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385db8-9703-4a10-806e-853728d4e2ae None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:27.806707 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385db8-9703-4a10-806e-853728d4e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:27.807181 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385db8-9703-4a10-806e-853728d4e2ae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:27.808042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385db8-9703-4a10-806e-853728d4e2ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:27.809817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385db8-9703-4a10-806e-853728d4e2ae None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5b385db8-9703-4a10-806e-853728d4e2ae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:27.831060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:27.832583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 20:18:27.834610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:27.839344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 451/912] 10.222.0.59 () {56 vars in 1132 bytes} [Thu May 12 20:18:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:27.846535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a04d2-8dc0-49c5-af14-f42c2ab6c14d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:27.974574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a04d2-8dc0-49c5-af14-f42c2ab6c14d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:27.977784 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217b41-6a32-4bc2-a605-11539fd934fb None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:27.978351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217b41-6a32-4bc2-a605-11539fd934fb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:27.978828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217b41-6a32-4bc2-a605-11539fd934fb None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:27.980913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 452/913] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:27.986517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4c524-d4b8-4aaa-a584-0479e930adf6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:27.987147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4c524-d4b8-4aaa-a584-0479e930adf6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:27.987635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4c524-d4b8-4aaa-a584-0479e930adf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.008297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b2b4c524-d4b8-4aaa-a584-0479e930adf6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:28.010544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b2b4c524-d4b8-4aaa-a584-0479e930adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:28.031045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357881d-8af2-4553-aaa9-80ddebc963fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:28.032066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357881d-8af2-4553-aaa9-80ddebc963fb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.032584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357881d-8af2-4553-aaa9-80ddebc963fb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.033011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357881d-8af2-4553-aaa9-80ddebc963fb None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.034593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357881d-8af2-4553-aaa9-80ddebc963fb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:28.035362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357881d-8af2-4553-aaa9-80ddebc963fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:28.039056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357881d-8af2-4553-aaa9-80ddebc963fb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:28.045397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 462/914] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:28.052692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357881d-8af2-4553-aaa9-80ddebc963fb None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:28.123645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 453/915] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:28.147155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4c524-d4b8-4aaa-a584-0479e930adf6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:28.195167 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357881d-8af2-4553-aaa9-80ddebc963fb None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:28.232759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7261ea-fd83-4ec7-872a-34ef575d6585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:28.233867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7261ea-fd83-4ec7-872a-34ef575d6585 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.234372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7261ea-fd83-4ec7-872a-34ef575d6585 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.234860 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7261ea-fd83-4ec7-872a-34ef575d6585 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.235766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7261ea-fd83-4ec7-872a-34ef575d6585 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:28.236269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7261ea-fd83-4ec7-872a-34ef575d6585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:28.237866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7261ea-fd83-4ec7-872a-34ef575d6585 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:28.244737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 463/916] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:28.253345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7261ea-fd83-4ec7-872a-34ef575d6585 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:28.284934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4c524-d4b8-4aaa-a584-0479e930adf6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:28.344146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa77d26-4068-47ab-a773-ed1bafa4730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:28.345373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa77d26-4068-47ab-a773-ed1bafa4730a None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.346024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa77d26-4068-47ab-a773-ed1bafa4730a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.346967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa77d26-4068-47ab-a773-ed1bafa4730a None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.349923 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa77d26-4068-47ab-a773-ed1bafa4730a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:28.354113 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa77d26-4068-47ab-a773-ed1bafa4730a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:28.376724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7261ea-fd83-4ec7-872a-34ef575d6585 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:28.429613 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddd48c-df33-445a-a2b0-2b4f35bc631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:28.430287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddd48c-df33-445a-a2b0-2b4f35bc631c None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.430569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddd48c-df33-445a-a2b0-2b4f35bc631c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.430844 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddd48c-df33-445a-a2b0-2b4f35bc631c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.431633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddd48c-df33-445a-a2b0-2b4f35bc631c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:28.433008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddd48c-df33-445a-a2b0-2b4f35bc631c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:28.442860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 454/917] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:18:28 2022] POST /identity/v3/services => generated 241 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:28.482692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fc22-5c52-4198-ac46-aeccd4d795ba None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.483329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fc22-5c52-4198-ac46-aeccd4d795ba None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.483329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fc22-5c52-4198-ac46-aeccd4d795ba None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.484815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 455/918] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:28.490764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f8657-7d28-45d0-a054-dc53d82ffd5c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.491054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f8657-7d28-45d0-a054-dc53d82ffd5c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.500723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f8657-7d28-45d0-a054-dc53d82ffd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.510044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ee7f8657-7d28-45d0-a054-dc53d82ffd5c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:28.511278 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ee7f8657-7d28-45d0-a054-dc53d82ffd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:28.526570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 464/919] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 12 20:18:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:28.604647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 456/920] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:28.628127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddd48c-df33-445a-a2b0-2b4f35bc631c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:28.641962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0c06-d392-4a63-935c-a02667ecc329 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.642309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0c06-d392-4a63-935c-a02667ecc329 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.642544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0c06-d392-4a63-935c-a02667ecc329 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.644335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 457/921] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:28.651751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723cad-8b9d-45c7-bfb9-ce851e95287b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.652039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723cad-8b9d-45c7-bfb9-ce851e95287b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.652393 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723cad-8b9d-45c7-bfb9-ce851e95287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.670203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5a723cad-8b9d-45c7-bfb9-ce851e95287b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:28.671423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5a723cad-8b9d-45c7-bfb9-ce851e95287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:28.747442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddd48c-df33-445a-a2b0-2b4f35bc631c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:28.766746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 458/922] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:28.789226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5845112-3f98-4853-b419-e2b89b7f48ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:28.790772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a723cad-8b9d-45c7-bfb9-ce851e95287b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:28.794106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5845112-3f98-4853-b419-e2b89b7f48ff None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.794393 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5845112-3f98-4853-b419-e2b89b7f48ff None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.795372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5845112-3f98-4853-b419-e2b89b7f48ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.812452 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5845112-3f98-4853-b419-e2b89b7f48ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-c5845112-3f98-4853-b419-e2b89b7f48ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:28.822714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:28.823679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:28.824515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 465/923] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 12 20:18:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:28.832551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5845112-3f98-4853-b419-e2b89b7f48ff None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:28.912048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a723cad-8b9d-45c7-bfb9-ce851e95287b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:28.935852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5845112-3f98-4853-b419-e2b89b7f48ff None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:28.948310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2690428-e381-44d7-9b4a-1cd60816ac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:28.949203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690428-e381-44d7-9b4a-1cd60816ac01 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.949600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690428-e381-44d7-9b4a-1cd60816ac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.949929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690428-e381-44d7-9b4a-1cd60816ac01 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.950603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2690428-e381-44d7-9b4a-1cd60816ac01 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:28.951979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2690428-e381-44d7-9b4a-1cd60816ac01 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f2690428-e381-44d7-9b4a-1cd60816ac01 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:28.965009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:28.966160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 20:18:28.967072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:28.971490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 459/924] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:18:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:28.972485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85531944-4fe2-47f2-8e5e-9b00f9190d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:28.972887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2690428-e381-44d7-9b4a-1cd60816ac01 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:28.973206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85531944-4fe2-47f2-8e5e-9b00f9190d3c None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:28.973616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85531944-4fe2-47f2-8e5e-9b00f9190d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:28.973900 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85531944-4fe2-47f2-8e5e-9b00f9190d3c None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:28.974668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85531944-4fe2-47f2-8e5e-9b00f9190d3c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:28.974986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85531944-4fe2-47f2-8e5e-9b00f9190d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:28.976374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85531944-4fe2-47f2-8e5e-9b00f9190d3c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:28.989609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 466/925] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 12 20:18:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:28.991448 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85531944-4fe2-47f2-8e5e-9b00f9190d3c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:29.105067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85531944-4fe2-47f2-8e5e-9b00f9190d3c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:29.114866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2690428-e381-44d7-9b4a-1cd60816ac01 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:29.141044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0532718-13e8-44a9-a2cc-8ad26194453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:29.141919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0532718-13e8-44a9-a2cc-8ad26194453c None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:29.142205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0532718-13e8-44a9-a2cc-8ad26194453c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:29.142484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0532718-13e8-44a9-a2cc-8ad26194453c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:29.154094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0532718-13e8-44a9-a2cc-8ad26194453c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:29.155766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0532718-13e8-44a9-a2cc-8ad26194453c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:29.155951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d677126-7b4d-4352-a33b-6392ee01d60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:29.156724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d677126-7b4d-4352-a33b-6392ee01d60b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:29.157333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d677126-7b4d-4352-a33b-6392ee01d60b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:29.157816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d677126-7b4d-4352-a33b-6392ee01d60b None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:29.158948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d677126-7b4d-4352-a33b-6392ee01d60b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:29.159311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d677126-7b4d-4352-a33b-6392ee01d60b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:29.161208 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d677126-7b4d-4352-a33b-6392ee01d60b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:29.168610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 460/926] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:18:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:29.174028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d677126-7b4d-4352-a33b-6392ee01d60b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-a0532718-13e8-44a9-a2cc-8ad26194453c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:29.177805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:29.179085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:29.180204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:29.180204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:29.180204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:29.180204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:29.184770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 467/927] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:29.186268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0532718-13e8-44a9-a2cc-8ad26194453c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:29.298258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0532718-13e8-44a9-a2cc-8ad26194453c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:29.298472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d677126-7b4d-4352-a33b-6392ee01d60b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:29.340143 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ab3b-627c-44a0-b862-a94d6cd64f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:29.340929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ab3b-627c-44a0-b862-a94d6cd64f47 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:29.341248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821c32f-e80f-4a52-a621-abfa6e398776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:29.341473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ab3b-627c-44a0-b862-a94d6cd64f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:29.341723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785ab3b-627c-44a0-b862-a94d6cd64f47 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:29.341943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c32f-e80f-4a52-a621-abfa6e398776 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:29.342233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c32f-e80f-4a52-a621-abfa6e398776 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:29.342512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c32f-e80f-4a52-a621-abfa6e398776 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:29.342673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785ab3b-627c-44a0-b862-a94d6cd64f47 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:29.343027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785ab3b-627c-44a0-b862-a94d6cd64f47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:29.343241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821c32f-e80f-4a52-a621-abfa6e398776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:29.343552 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821c32f-e80f-4a52-a621-abfa6e398776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:29.344599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785ab3b-627c-44a0-b862-a94d6cd64f47 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:29.344901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821c32f-e80f-4a52-a621-abfa6e398776 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:29.355613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 461/928] 10.222.0.59 () {56 vars in 1114 bytes} [Thu May 12 20:18:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:29.356882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ab3b-627c-44a0-b862-a94d6cd64f47 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:29.359057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 468/929] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:29.366419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821c32f-e80f-4a52-a621-abfa6e398776 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:29.475049 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821c32f-e80f-4a52-a621-abfa6e398776 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:29.489484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785ab3b-627c-44a0-b862-a94d6cd64f47 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:29.515113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2325641-fed5-4781-bf36-fd3839535b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:29.516533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2325641-fed5-4781-bf36-fd3839535b28 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:29.516922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2325641-fed5-4781-bf36-fd3839535b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:29.517567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2325641-fed5-4781-bf36-fd3839535b28 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:29.527736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2325641-fed5-4781-bf36-fd3839535b28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:29.529746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2325641-fed5-4781-bf36-fd3839535b28 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:29.534592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76be96-0b43-40f7-a206-eca94a5ecce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:29.535460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76be96-0b43-40f7-a206-eca94a5ecce5 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:29.536415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76be96-0b43-40f7-a206-eca94a5ecce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:29.537091 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76be96-0b43-40f7-a206-eca94a5ecce5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:29.538004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76be96-0b43-40f7-a206-eca94a5ecce5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:29.539424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76be96-0b43-40f7-a206-eca94a5ecce5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-f2325641-fed5-4781-bf36-fd3839535b28 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:29.550534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:29.551747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:29.553257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 469/930] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 12 20:18:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:29.558504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2325641-fed5-4781-bf36-fd3839535b28 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:29.641715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 462/931] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 12 20:18:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:29.682468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2325641-fed5-4781-bf36-fd3839535b28 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:29.734249 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287ca29-77b0-4d58-858b-319e09b95743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:29.735251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ca29-77b0-4d58-858b-319e09b95743 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:29.735718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ca29-77b0-4d58-858b-319e09b95743 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:29.736203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ca29-77b0-4d58-858b-319e09b95743 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:29.737327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287ca29-77b0-4d58-858b-319e09b95743 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:29.737854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287ca29-77b0-4d58-858b-319e09b95743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:29.739684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287ca29-77b0-4d58-858b-319e09b95743 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:29.767289 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 470/932] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 12 20:18:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:29.774103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76be96-0b43-40f7-a206-eca94a5ecce5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:29.892987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76be96-0b43-40f7-a206-eca94a5ecce5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:29.935214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3930ea-0349-4fd3-b8fd-d419348484ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:29.936022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3930ea-0349-4fd3-b8fd-d419348484ee None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:29.936309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3930ea-0349-4fd3-b8fd-d419348484ee None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:29.936587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3930ea-0349-4fd3-b8fd-d419348484ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:29.948667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3930ea-0349-4fd3-b8fd-d419348484ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:29.950243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3930ea-0349-4fd3-b8fd-d419348484ee None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-1f3930ea-0349-4fd3-b8fd-d419348484ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:29.968149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:29.969090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:29.970170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:29.970170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:29.970170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:29.970170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:29.970170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 463/933] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:29.975262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287ca29-77b0-4d58-858b-319e09b95743 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:30.078516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287ca29-77b0-4d58-858b-319e09b95743 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:30.113198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7ca28-6dd5-4634-8923-d8145230598a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:30.114517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7ca28-6dd5-4634-8923-d8145230598a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:30.114928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7ca28-6dd5-4634-8923-d8145230598a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:30.115215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7ca28-6dd5-4634-8923-d8145230598a None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:30.115950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7ca28-6dd5-4634-8923-d8145230598a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:30.116261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7ca28-6dd5-4634-8923-d8145230598a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:30.117708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7ca28-6dd5-4634-8923-d8145230598a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:30.131654 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 471/934] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:30.137296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3930ea-0349-4fd3-b8fd-d419348484ee None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:30.237132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3930ea-0349-4fd3-b8fd-d419348484ee None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:30.272560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9550901-17f7-45b3-8c76-7c0021f2fe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:30.273395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550901-17f7-45b3-8c76-7c0021f2fe01 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:30.273684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550901-17f7-45b3-8c76-7c0021f2fe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:30.273963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9550901-17f7-45b3-8c76-7c0021f2fe01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:30.283569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9550901-17f7-45b3-8c76-7c0021f2fe01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:30.285032 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9550901-17f7-45b3-8c76-7c0021f2fe01 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b9550901-17f7-45b3-8c76-7c0021f2fe01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:30.300574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:30.302868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:30.305626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:30.305626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:30.305626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:30.305626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:30.305626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:30.305626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:30.305626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:30.305626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:30.305626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 464/935] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:30.309389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7ca28-6dd5-4634-8923-d8145230598a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:30.416872 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7ca28-6dd5-4634-8923-d8145230598a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:30.454640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f48ced-4d33-4016-9d70-9e82139a6441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:30.455673 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f48ced-4d33-4016-9d70-9e82139a6441 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:30.456161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f48ced-4d33-4016-9d70-9e82139a6441 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:30.456682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f48ced-4d33-4016-9d70-9e82139a6441 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:30.458278 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f48ced-4d33-4016-9d70-9e82139a6441 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:30.458879 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f48ced-4d33-4016-9d70-9e82139a6441 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:30.460556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f48ced-4d33-4016-9d70-9e82139a6441 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:30.475443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 472/936] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:30.480917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9550901-17f7-45b3-8c76-7c0021f2fe01 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:30.590434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9550901-17f7-45b3-8c76-7c0021f2fe01 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:30.627530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299a823-4824-40f5-b71d-dd494383856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:30.628443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a823-4824-40f5-b71d-dd494383856d None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:30.628733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a823-4824-40f5-b71d-dd494383856d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:30.629012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a823-4824-40f5-b71d-dd494383856d None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/650c0f54ab04442dba1af80d84417da0/roles/36d9055ee9d74c3cb9c5c4c6599dffbd` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:30.631630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299a823-4824-40f5-b71d-dd494383856d None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=650c0f54ab04442dba1af80d84417da0, role_id=36d9055ee9d74c3cb9c5c4c6599dffbd)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:30.633071 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299a823-4824-40f5-b71d-dd494383856d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:30.719819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 465/937] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:18:30 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/650c0f54ab04442dba1af80d84417da0/roles/36d9055ee9d74c3cb9c5c4c6599dffbd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:18:30.875387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214ab8-1900-4c17-a8e0-ce92cfe945e5 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:30.875913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214ab8-1900-4c17-a8e0-ce92cfe945e5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:30.875990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214ab8-1900-4c17-a8e0-ce92cfe945e5 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:30.877555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 473/938] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:30.883476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a496fc-fba7-47ae-b482-3791843ff03a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:30.883840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a496fc-fba7-47ae-b482-3791843ff03a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:30.884276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a496fc-fba7-47ae-b482-3791843ff03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:30.903947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-56a496fc-fba7-47ae-b482-3791843ff03a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:30.905183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-56a496fc-fba7-47ae-b482-3791843ff03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:30.988518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 466/939] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:31.011178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3214ab8-1900-4c17-a8e0-ce92cfe945e5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:31.037561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cd6b0-1538-45d7-9a41-ddaa1c7616d4 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:31.038093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cd6b0-1538-45d7-9a41-ddaa1c7616d4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:31.038954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cd6b0-1538-45d7-9a41-ddaa1c7616d4 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:31.043197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 467/940] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:31.048350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887c552-674e-4ba0-8358-e465cd6e1136 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:31.048869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887c552-674e-4ba0-8358-e465cd6e1136 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:31.054328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887c552-674e-4ba0-8358-e465cd6e1136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:31.069738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0887c552-674e-4ba0-8358-e465cd6e1136 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:31.072070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0887c552-674e-4ba0-8358-e465cd6e1136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:31.141981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3214ab8-1900-4c17-a8e0-ce92cfe945e5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:31.170213 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 468/941] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:31.184621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ae1c7-66f5-4fe0-b58e-1a4e239a48ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:31.185479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ae1c7-66f5-4fe0-b58e-1a4e239a48ad None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:31.185770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ae1c7-66f5-4fe0-b58e-1a4e239a48ad None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:31.186054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ae1c7-66f5-4fe0-b58e-1a4e239a48ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:31.186727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ae1c7-66f5-4fe0-b58e-1a4e239a48ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:31.188117 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ae1c7-66f5-4fe0-b58e-1a4e239a48ad None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:31.198818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887c552-674e-4ba0-8358-e465cd6e1136 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-0a7ae1c7-66f5-4fe0-b58e-1a4e239a48ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:31.204647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:31.205698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:31.206704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 474/942] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:31.218587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ae1c7-66f5-4fe0-b58e-1a4e239a48ad None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:31.321863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887c552-674e-4ba0-8358-e465cd6e1136 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:31.326988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ae1c7-66f5-4fe0-b58e-1a4e239a48ad None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:31.361759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501928e4-e720-429d-9e89-43e85d212e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:31.362285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2350-5a2c-40b3-a141-337700cf555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:31.362731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501928e4-e720-429d-9e89-43e85d212e25 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:31.362952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2350-5a2c-40b3-a141-337700cf555f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:31.363145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501928e4-e720-429d-9e89-43e85d212e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:31.363267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2350-5a2c-40b3-a141-337700cf555f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:31.363507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2350-5a2c-40b3-a141-337700cf555f None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:31.363612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501928e4-e720-429d-9e89-43e85d212e25 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:31.364795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d2350-5a2c-40b3-a141-337700cf555f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:31.364905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501928e4-e720-429d-9e89-43e85d212e25 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:31.366970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d2350-5a2c-40b3-a141-337700cf555f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:31.366970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d2350-5a2c-40b3-a141-337700cf555f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:31.367167 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501928e4-e720-429d-9e89-43e85d212e25 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:31.376516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 475/943] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 12 20:18:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:31.377679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2350-5a2c-40b3-a141-337700cf555f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-501928e4-e720-429d-9e89-43e85d212e25 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:31.380988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:31.382070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 20:18:31.382919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:31.383873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 469/944] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:31.389984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501928e4-e720-429d-9e89-43e85d212e25 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:31.499311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2350-5a2c-40b3-a141-337700cf555f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:31.505915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501928e4-e720-429d-9e89-43e85d212e25 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:31.533463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226edc4-0ea6-4d8c-995e-1af30adbd8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:31.534141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226edc4-0ea6-4d8c-995e-1af30adbd8bc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:31.534423 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226edc4-0ea6-4d8c-995e-1af30adbd8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:31.534702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226edc4-0ea6-4d8c-995e-1af30adbd8bc None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:31.535416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226edc4-0ea6-4d8c-995e-1af30adbd8bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:31.536318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226edc4-0ea6-4d8c-995e-1af30adbd8bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:31.537789 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226edc4-0ea6-4d8c-995e-1af30adbd8bc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:31.541182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a25176-bfba-430f-aa79-077d1f1171d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:31.541918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a25176-bfba-430f-aa79-077d1f1171d9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:31.542206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a25176-bfba-430f-aa79-077d1f1171d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:31.542491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a25176-bfba-430f-aa79-077d1f1171d9 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:31.543203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a25176-bfba-430f-aa79-077d1f1171d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:31.543516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a25176-bfba-430f-aa79-077d1f1171d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:31.544883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a25176-bfba-430f-aa79-077d1f1171d9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:31.547722 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 476/945] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 12 20:18:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:31.548594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226edc4-0ea6-4d8c-995e-1af30adbd8bc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:31.550337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 470/946] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:31.558288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a25176-bfba-430f-aa79-077d1f1171d9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:31.664028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a25176-bfba-430f-aa79-077d1f1171d9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:31.678614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226edc4-0ea6-4d8c-995e-1af30adbd8bc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:31.702967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c57221-cdad-4256-a872-e3e9f1764917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:31.703541 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c57221-cdad-4256-a872-e3e9f1764917 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:31.703881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c57221-cdad-4256-a872-e3e9f1764917 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:31.704158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c57221-cdad-4256-a872-e3e9f1764917 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:31.704930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c57221-cdad-4256-a872-e3e9f1764917 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:31.705212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c57221-cdad-4256-a872-e3e9f1764917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:31.706612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c57221-cdad-4256-a872-e3e9f1764917 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:31.716369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 471/947] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:31.720820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375a04-e078-4e62-be75-14426c276517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:31.721913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375a04-e078-4e62-be75-14426c276517 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:31.722409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375a04-e078-4e62-be75-14426c276517 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:31.722888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375a04-e078-4e62-be75-14426c276517 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:31.725150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375a04-e078-4e62-be75-14426c276517 None admin] RBAC: Adding query filter params (interface=public, service_id=9419545ecc2d43db8ce7459814815030, region_id=RegionOne) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:31.725759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375a04-e078-4e62-be75-14426c276517 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:31.727469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375a04-e078-4e62-be75-14426c276517 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:31.733980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 477/948] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 12 20:18:31 2022] GET /identity/v3/endpoints?service_id=9419545ecc2d43db8ce7459814815030&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:31.742422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c57221-cdad-4256-a872-e3e9f1764917 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:31.852233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c57221-cdad-4256-a872-e3e9f1764917 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:31.888778 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c1d78-768a-4888-bf3d-73abcc861d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:31.889498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c1d78-768a-4888-bf3d-73abcc861d40 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:31.889790 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c1d78-768a-4888-bf3d-73abcc861d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:31.890069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c1d78-768a-4888-bf3d-73abcc861d40 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:31.890767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c1d78-768a-4888-bf3d-73abcc861d40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:31.892163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c1d78-768a-4888-bf3d-73abcc861d40 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:31.899718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 472/949] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 12 20:18:31 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:18:32.184955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f731222-b77a-4e3e-b41c-44f690aad3b3 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:32.185554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f731222-b77a-4e3e-b41c-44f690aad3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:32.185554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f731222-b77a-4e3e-b41c-44f690aad3b3 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:32.187089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 478/950] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:32.192604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53519b6e-86be-4e63-829e-17c8eff88528 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:32.192903 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53519b6e-86be-4e63-829e-17c8eff88528 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:32.193170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53519b6e-86be-4e63-829e-17c8eff88528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:32.211095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-53519b6e-86be-4e63-829e-17c8eff88528 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:32.212292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-53519b6e-86be-4e63-829e-17c8eff88528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:32.281189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 473/951] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:32.307295 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f731222-b77a-4e3e-b41c-44f690aad3b3 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:32.440425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f731222-b77a-4e3e-b41c-44f690aad3b3 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:32.488233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:32.489111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:32.489518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:32.489852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:32.490590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:32.492087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:32.494216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: WARNING keystone.server.flask.common [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 20:18:32.557542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.sql.core [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 20:18:32.557542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 20:18:32.557542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [parameters: {'id': 'bcc3cf0a2b664a83bde20ad12c8ca393', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 20:18:32.557542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80203) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bcc3cf0a2b664a83bde20ad12c8ca393.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bcc3cf0a2b664a83bde20ad12c8ca393. May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application result = self._query(query) May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application conn.query(q) May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 20:18:32.575364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application result.read() May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 20:18:32.577309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application next(self.gen) May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application yield resource May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application next(self.gen) May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.session.rollback() May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.force_reraise() May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise self.value May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application session.commit() May 12 20:18:32.580952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._prepare_impl() May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.session.flush() May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._flush(objects) May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application compat.raise_( May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application flush_context.execute() May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 20:18:32.584561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rec.execute(self) May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 20:18:32.587342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application result = self._query(query) May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application conn.query(q) May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application result.read() May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 20:18:32.589194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [parameters: {'id': 'bcc3cf0a2b664a83bde20ad12c8ca393', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:32.599151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:32.600111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:32.601260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:32.601260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 20:18:32.601260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 20:18:32.601260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:32.601260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:32.601260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 20:18:32.601260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 20:18:32.601260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bcc3cf0a2b664a83bde20ad12c8ca393. May 12 20:18:32.601260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:32.601260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 479/952] 10.222.0.59 () {60 vars in 1140 bytes} [Thu May 12 20:18:32 2022] POST /identity/v3/projects => generated 262 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:32.601990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53519b6e-86be-4e63-829e-17c8eff88528 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:32.698910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53519b6e-86be-4e63-829e-17c8eff88528 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:32.736750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e0fb8-ccba-43e8-9d10-1c9e53568710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:32.737835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e0fb8-ccba-43e8-9d10-1c9e53568710 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:32.738263 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e0fb8-ccba-43e8-9d10-1c9e53568710 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:32.739533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e0fb8-ccba-43e8-9d10-1c9e53568710 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:32.747687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e0fb8-ccba-43e8-9d10-1c9e53568710 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:32.749481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e0fb8-ccba-43e8-9d10-1c9e53568710 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-656e0fb8-ccba-43e8-9d10-1c9e53568710 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:32.766691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:32.767822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:32.768941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:32.768941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:32.768941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:32.768941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:32.768941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:32.768941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:32.768941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:32.768941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:32.771790 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 474/953] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:32.777782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:32.885523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6703e-4895-47e5-941b-7d1add964261 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:32.921420 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded9300-f1d6-45d3-91d5-49ec9a9c0618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:32.922513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded9300-f1d6-45d3-91d5-49ec9a9c0618 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:32.922999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded9300-f1d6-45d3-91d5-49ec9a9c0618 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:32.923461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded9300-f1d6-45d3-91d5-49ec9a9c0618 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:32.924797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded9300-f1d6-45d3-91d5-49ec9a9c0618 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:32.925389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded9300-f1d6-45d3-91d5-49ec9a9c0618 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:32.929132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded9300-f1d6-45d3-91d5-49ec9a9c0618 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:32.968318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 480/954] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:33.238493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d622df4-6018-4615-98f4-0c3fe3e0cfbb None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:33.239915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d622df4-6018-4615-98f4-0c3fe3e0cfbb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:33.240559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d622df4-6018-4615-98f4-0c3fe3e0cfbb None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:33.242609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 475/955] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:33.249074 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ae9b5-e146-4277-9a18-025360f5339e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:33.250080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ae9b5-e146-4277-9a18-025360f5339e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:33.250574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ae9b5-e146-4277-9a18-025360f5339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:33.269032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-924ae9b5-e146-4277-9a18-025360f5339e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:33.271931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-924ae9b5-e146-4277-9a18-025360f5339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:33.347731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 481/956] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:33.372636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d622df4-6018-4615-98f4-0c3fe3e0cfbb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:33.479552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d622df4-6018-4615-98f4-0c3fe3e0cfbb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:33.516662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e2603-0b25-4fac-8adc-9120913345b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:33.517901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e2603-0b25-4fac-8adc-9120913345b7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:33.518397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e2603-0b25-4fac-8adc-9120913345b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:33.518877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e2603-0b25-4fac-8adc-9120913345b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:33.530359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e2603-0b25-4fac-8adc-9120913345b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ac6e2603-0b25-4fac-8adc-9120913345b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:33.540217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:33.541162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:33.542044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:33.549375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 476/957] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 12 20:18:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:33.552520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ae9b5-e146-4277-9a18-025360f5339e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:33.659908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ae9b5-e146-4277-9a18-025360f5339e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:33.695888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ce19e-d8cc-463a-acd2-725cd2c202ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:33.696578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ce19e-d8cc-463a-acd2-725cd2c202ea None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:33.696865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ce19e-d8cc-463a-acd2-725cd2c202ea None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:33.697148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ce19e-d8cc-463a-acd2-725cd2c202ea None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:33.697947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ce19e-d8cc-463a-acd2-725cd2c202ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:33.698257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ce19e-d8cc-463a-acd2-725cd2c202ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:33.699715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ce19e-d8cc-463a-acd2-725cd2c202ea None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:33.709250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 482/958] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 12 20:18:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:33.714782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e2603-0b25-4fac-8adc-9120913345b7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:33.828000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e2603-0b25-4fac-8adc-9120913345b7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:33.869310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1badae8-35f5-4af6-8aeb-4a805909797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:33.869310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1badae8-35f5-4af6-8aeb-4a805909797a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:33.869310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1badae8-35f5-4af6-8aeb-4a805909797a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:33.869310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1badae8-35f5-4af6-8aeb-4a805909797a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:33.878733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1badae8-35f5-4af6-8aeb-4a805909797a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:33.881163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1badae8-35f5-4af6-8aeb-4a805909797a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c1badae8-35f5-4af6-8aeb-4a805909797a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:33.899933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:33.900859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:33.901770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:33.901770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:33.901770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:33.901770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:33.905556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 477/959] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:33.907114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ce19e-d8cc-463a-acd2-725cd2c202ea None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:34.031422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ce19e-d8cc-463a-acd2-725cd2c202ea None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:34.070243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d7d01-d22d-44f0-9b9d-710b89adb6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:34.071331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7d01-d22d-44f0-9b9d-710b89adb6dc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.071886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7d01-d22d-44f0-9b9d-710b89adb6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.072385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7d01-d22d-44f0-9b9d-710b89adb6dc None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.073439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d7d01-d22d-44f0-9b9d-710b89adb6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:34.074012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d7d01-d22d-44f0-9b9d-710b89adb6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:34.075683 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d7d01-d22d-44f0-9b9d-710b89adb6dc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:34.090464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 483/960] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:34.097317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1badae8-35f5-4af6-8aeb-4a805909797a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:34.173567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6096f-ebbe-4116-a7cf-d857070bc22f None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.174248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6096f-ebbe-4116-a7cf-d857070bc22f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.174747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6096f-ebbe-4116-a7cf-d857070bc22f None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.177255 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 484/961] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:34.182672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa6966-48c8-454f-a080-5248f297f162 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.183556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa6966-48c8-454f-a080-5248f297f162 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.184054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa6966-48c8-454f-a080-5248f297f162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.206121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1badae8-35f5-4af6-8aeb-4a805909797a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:34.210111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-ebaa6966-48c8-454f-a080-5248f297f162 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:34.211586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ebaa6966-48c8-454f-a080-5248f297f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:34.243002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080cd1d-9d16-4ada-90cb-2ddba2cb74ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:34.244215 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080cd1d-9d16-4ada-90cb-2ddba2cb74ee None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.244495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080cd1d-9d16-4ada-90cb-2ddba2cb74ee None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.244765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080cd1d-9d16-4ada-90cb-2ddba2cb74ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.254120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080cd1d-9d16-4ada-90cb-2ddba2cb74ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:34.256101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080cd1d-9d16-4ada-90cb-2ddba2cb74ee None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c080cd1d-9d16-4ada-90cb-2ddba2cb74ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:34.272410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:34.273481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:34.274417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:34.274417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:34.274417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:34.274417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:34.274417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:34.274417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:34.274417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:34.274417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:34.274417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 20:18:34.274417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:34.278298 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 478/962] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 12 20:18:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:34.279626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080cd1d-9d16-4ada-90cb-2ddba2cb74ee None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:34.300729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 485/963] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:34.302793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c73706-cbc2-428b-a771-578acdacb848 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.303084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c73706-cbc2-428b-a771-578acdacb848 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.303366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c73706-cbc2-428b-a771-578acdacb848 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.304672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 486/964] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:34.311810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4040-e40e-4fa7-94fe-0288cc9d8017 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.312301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4040-e40e-4fa7-94fe-0288cc9d8017 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.312895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c4040-e40e-4fa7-94fe-0288cc9d8017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.334660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5b8c4040-e40e-4fa7-94fe-0288cc9d8017 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:34.336799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5b8c4040-e40e-4fa7-94fe-0288cc9d8017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:34.389315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080cd1d-9d16-4ada-90cb-2ddba2cb74ee None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:34.423117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc69d0a-e95b-4f13-8355-75849147889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:34.423800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc69d0a-e95b-4f13-8355-75849147889f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.424090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc69d0a-e95b-4f13-8355-75849147889f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.424370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc69d0a-e95b-4f13-8355-75849147889f None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.425215 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc69d0a-e95b-4f13-8355-75849147889f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:34.425558 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc69d0a-e95b-4f13-8355-75849147889f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:34.427552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc69d0a-e95b-4f13-8355-75849147889f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:34.445301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 487/965] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:34.445301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c4040-e40e-4fa7-94fe-0288cc9d8017 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:34.458696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 479/966] 10.222.0.59 () {56 vars in 1149 bytes} [Thu May 12 20:18:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:34.464302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc69d0a-e95b-4f13-8355-75849147889f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:34.555600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c4040-e40e-4fa7-94fe-0288cc9d8017 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:34.577696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc69d0a-e95b-4f13-8355-75849147889f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:34.596989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b2b8d-053d-429e-b12f-468d5c4e7f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:34.597690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2b8d-053d-429e-b12f-468d5c4e7f06 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.598641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2b8d-053d-429e-b12f-468d5c4e7f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.598904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b2b8d-053d-429e-b12f-468d5c4e7f06 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.599959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b2b8d-053d-429e-b12f-468d5c4e7f06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:34.601781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b2b8d-053d-429e-b12f-468d5c4e7f06 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:34.613856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1ee1a-1355-4fcd-beac-e3ba8819bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:34.614674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1ee1a-1355-4fcd-beac-e3ba8819bd1b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.614960 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1ee1a-1355-4fcd-beac-e3ba8819bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.615244 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1ee1a-1355-4fcd-beac-e3ba8819bd1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.615901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1ee1a-1355-4fcd-beac-e3ba8819bd1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:34.617335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1ee1a-1355-4fcd-beac-e3ba8819bd1b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f1f1ee1a-1355-4fcd-beac-e3ba8819bd1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:34.629344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:34.636597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:34.637526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 480/967] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:34.638354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1ee1a-1355-4fcd-beac-e3ba8819bd1b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:34.678806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 488/968] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:18:34 2022] POST /identity/v3/services => generated 242 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:34.679881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b2b8d-053d-429e-b12f-468d5c4e7f06 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:34.773858 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1ee1a-1355-4fcd-beac-e3ba8819bd1b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:34.821934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b2b8d-053d-429e-b12f-468d5c4e7f06 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:34.826279 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37781aa-e1a4-4bb2-ae67-2b97ac078128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:34.827264 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37781aa-e1a4-4bb2-ae67-2b97ac078128 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.827755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37781aa-e1a4-4bb2-ae67-2b97ac078128 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.828231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37781aa-e1a4-4bb2-ae67-2b97ac078128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.876365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c946-ee19-4158-8516-d75982334826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:34.878236 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c946-ee19-4158-8516-d75982334826 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:34.878714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c946-ee19-4158-8516-d75982334826 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:34.879873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c946-ee19-4158-8516-d75982334826 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:34.880967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c946-ee19-4158-8516-d75982334826 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:34.881498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c946-ee19-4158-8516-d75982334826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:34.883124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c946-ee19-4158-8516-d75982334826 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:34.891542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 489/969] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 12 20:18:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:34.898321 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c946-ee19-4158-8516-d75982334826 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:34.924917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37781aa-e1a4-4bb2-ae67-2b97ac078128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:34.927388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37781aa-e1a4-4bb2-ae67-2b97ac078128 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:35.020360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c946-ee19-4158-8516-d75982334826 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:35.050517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 481/970] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:34 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:18:35.056413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37781aa-e1a4-4bb2-ae67-2b97ac078128 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:35.068028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7104051-bb9a-4eb3-b19a-d518708fdfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:35.069038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7104051-bb9a-4eb3-b19a-d518708fdfcc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:35.069564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7104051-bb9a-4eb3-b19a-d518708fdfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:35.070044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7104051-bb9a-4eb3-b19a-d518708fdfcc None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:35.071119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7104051-bb9a-4eb3-b19a-d518708fdfcc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:35.071678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7104051-bb9a-4eb3-b19a-d518708fdfcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:35.073268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7104051-bb9a-4eb3-b19a-d518708fdfcc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:35.083509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 490/971] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 12 20:18:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:35.084703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7104051-bb9a-4eb3-b19a-d518708fdfcc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:35.160215 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37781aa-e1a4-4bb2-ae67-2b97ac078128 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:35.194523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7104051-bb9a-4eb3-b19a-d518708fdfcc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:35.198152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08565d-1d98-438e-b358-18157960b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:35.198741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08565d-1d98-438e-b358-18157960b15b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:35.199094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08565d-1d98-438e-b358-18157960b15b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:35.199440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08565d-1d98-438e-b358-18157960b15b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:35.211575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08565d-1d98-438e-b358-18157960b15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:35.213144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08565d-1d98-438e-b358-18157960b15b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8b08565d-1d98-438e-b358-18157960b15b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:35.234420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:35.235440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:35.236378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:35.236378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:35.236378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:35.236378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:35.240861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 482/972] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:35.241800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08565d-1d98-438e-b358-18157960b15b None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:35.241910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf653-5b4a-44ba-a1a0-036f6b06955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:35.242922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf653-5b4a-44ba-a1a0-036f6b06955b None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:35.243422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf653-5b4a-44ba-a1a0-036f6b06955b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:35.244161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf653-5b4a-44ba-a1a0-036f6b06955b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:35.245169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf653-5b4a-44ba-a1a0-036f6b06955b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:35.246999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf653-5b4a-44ba-a1a0-036f6b06955b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:35.340027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 491/973] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 12 20:18:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:35.344493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a9555-5b6d-47ab-8249-4699762124ed None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:35.344493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a9555-5b6d-47ab-8249-4699762124ed None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:35.344493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a9555-5b6d-47ab-8249-4699762124ed None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:35.344493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 492/974] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:35.349800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83877e79-73d5-4f14-9d3b-1d7e438df93e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:35.350015 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83877e79-73d5-4f14-9d3b-1d7e438df93e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:35.350190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83877e79-73d5-4f14-9d3b-1d7e438df93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:35.353542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08565d-1d98-438e-b358-18157960b15b None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:35.368691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-83877e79-73d5-4f14-9d3b-1d7e438df93e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:35.370410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-83877e79-73d5-4f14-9d3b-1d7e438df93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:35.408492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c484c3c-1c85-4d42-a5ab-1621d8216fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:35.410115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c484c3c-1c85-4d42-a5ab-1621d8216fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:35.411186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c484c3c-1c85-4d42-a5ab-1621d8216fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:35.411376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c484c3c-1c85-4d42-a5ab-1621d8216fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:35.412198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c484c3c-1c85-4d42-a5ab-1621d8216fb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:35.412514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c484c3c-1c85-4d42-a5ab-1621d8216fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:35.413990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c484c3c-1c85-4d42-a5ab-1621d8216fb7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:35.431893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 483/975] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:35.433101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c484c3c-1c85-4d42-a5ab-1621d8216fb7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:35.466275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 493/976] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:35.491768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83877e79-73d5-4f14-9d3b-1d7e438df93e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:35.551837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c484c3c-1c85-4d42-a5ab-1621d8216fb7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:35.605194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eb852-3b56-445a-8524-85819b37deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:35.606371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb852-3b56-445a-8524-85819b37deae None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:35.606658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb852-3b56-445a-8524-85819b37deae None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:35.607304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb852-3b56-445a-8524-85819b37deae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:35.618635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eb852-3b56-445a-8524-85819b37deae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:35.620494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eb852-3b56-445a-8524-85819b37deae None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:35.628222 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83877e79-73d5-4f14-9d3b-1d7e438df93e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-a88eb852-3b56-445a-8524-85819b37deae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:35.637394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:35.638528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:35.639751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:35.639751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:35.639751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:35.639751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:35.639751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:35.639751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:35.639751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:35.639751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:35.639751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 484/977] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:35.644445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eb852-3b56-445a-8524-85819b37deae None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:35.676060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9ae11-fbf8-41ed-9188-2aef8e5a128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:35.677357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9ae11-fbf8-41ed-9188-2aef8e5a128d None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:35.677822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9ae11-fbf8-41ed-9188-2aef8e5a128d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:35.678460 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9ae11-fbf8-41ed-9188-2aef8e5a128d None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:35.680239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9ae11-fbf8-41ed-9188-2aef8e5a128d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:35.682341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9ae11-fbf8-41ed-9188-2aef8e5a128d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:35.730534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.sql.core [None req-13c9ae11-fbf8-41ed-9188-2aef8e5a128d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 20:18:35.730534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 20:18:35.730534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [parameters: {'user_id': '56ecd0dffa38440880bae6423d044404', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 20:18:35.730534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80203) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-13c9ae11-fbf8-41ed-9188-2aef8e5a128d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application result = self._query(query) May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application conn.query(q) May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application result.read() May 12 20:18:35.740889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 20:18:35.741984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application next(self.gen) May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application yield resource May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application next(self.gen) May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.session.rollback() May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.force_reraise() May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise self.value May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application session.commit() May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 20:18:35.742938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._prepare_impl() May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.session.flush() May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._flush(objects) May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application compat.raise_( May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application flush_context.execute() May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rec.execute(self) May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 20:18:35.744272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 20:18:35.745194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application result = self._query(query) May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application conn.query(q) May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application result.read() May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 20:18:35.746085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [parameters: {'user_id': '56ecd0dffa38440880bae6423d044404', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:35.747004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 20:18:35.747809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 20:18:35.748791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 20:18:35.748791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 20:18:35.748791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 20:18:35.748791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 20:18:35.748791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 20:18:35.748791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:35.752998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 494/978] 10.222.0.59 () {60 vars in 1131 bytes} [Thu May 12 20:18:35 2022] POST /identity/v3/users => generated 160 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:35.762637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9ae11-fbf8-41ed-9188-2aef8e5a128d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:35.781013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eb852-3b56-445a-8524-85819b37deae None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:35.844873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb966d3-c0b0-478e-b0b7-641407e68c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:35.845730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb966d3-c0b0-478e-b0b7-641407e68c02 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:35.846091 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb966d3-c0b0-478e-b0b7-641407e68c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:35.846438 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb966d3-c0b0-478e-b0b7-641407e68c02 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:35.847313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb966d3-c0b0-478e-b0b7-641407e68c02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:35.847705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb966d3-c0b0-478e-b0b7-641407e68c02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:35.849306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb966d3-c0b0-478e-b0b7-641407e68c02 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:35.866476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 485/979] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:35.874431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb966d3-c0b0-478e-b0b7-641407e68c02 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:35.903997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9ae11-fbf8-41ed-9188-2aef8e5a128d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:35.949672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaaf66-9a0a-4e14-b767-75babd1a1487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:35.950846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaaf66-9a0a-4e14-b767-75babd1a1487 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:35.951360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaaf66-9a0a-4e14-b767-75babd1a1487 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:35.951851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaaf66-9a0a-4e14-b767-75babd1a1487 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:35.960624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaaf66-9a0a-4e14-b767-75babd1a1487 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:35.962674 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaaf66-9a0a-4e14-b767-75babd1a1487 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-8afaaf66-9a0a-4e14-b767-75babd1a1487 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:35.978708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:35.979697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:35.980628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:35.980628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:35.980628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:35.980628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:35.980628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:35.980628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:35.980628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:35.980628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:35.980628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 20:18:35.980628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:35.983324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 495/980] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:18:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:35.988721 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaaf66-9a0a-4e14-b767-75babd1a1487 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:36.012500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb966d3-c0b0-478e-b0b7-641407e68c02 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:36.049846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2458d-9637-4ab8-97be-16aadf0fb6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:36.050808 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2458d-9637-4ab8-97be-16aadf0fb6fe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:36.051279 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2458d-9637-4ab8-97be-16aadf0fb6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:36.051900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2458d-9637-4ab8-97be-16aadf0fb6fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:36.052898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2458d-9637-4ab8-97be-16aadf0fb6fe None admin] RBAC: Adding query filter params (role.id=36d9055ee9d74c3cb9c5c4c6599dffbd, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=650c0f54ab04442dba1af80d84417da0) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:36.053385 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2458d-9637-4ab8-97be-16aadf0fb6fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:36.055360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2458d-9637-4ab8-97be-16aadf0fb6fe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:36.062281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 486/981] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:35 2022] GET /identity/v3/role_assignments?user.id=650c0f54ab04442dba1af80d84417da0&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=36d9055ee9d74c3cb9c5c4c6599dffbd => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:36.106962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaaf66-9a0a-4e14-b767-75babd1a1487 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:36.145261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9e000-0cd3-4f6d-8757-63837f98f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:36.146672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9e000-0cd3-4f6d-8757-63837f98f844 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:36.146957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9e000-0cd3-4f6d-8757-63837f98f844 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:36.147239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9e000-0cd3-4f6d-8757-63837f98f844 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:36.148164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9e000-0cd3-4f6d-8757-63837f98f844 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:36.148473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9e000-0cd3-4f6d-8757-63837f98f844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:36.150035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9e000-0cd3-4f6d-8757-63837f98f844 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:36.193312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 496/982] 10.222.0.59 () {56 vars in 1101 bytes} [Thu May 12 20:18:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:37.053890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a772-2db8-4c19-bf8c-6b11db840ebe None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:37.054419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a772-2db8-4c19-bf8c-6b11db840ebe None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:37.054498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a772-2db8-4c19-bf8c-6b11db840ebe None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:37.055817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 487/983] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:37.061802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df036-f0ab-40ee-8960-d411556d8879 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:37.062257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df036-f0ab-40ee-8960-d411556d8879 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:37.062440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df036-f0ab-40ee-8960-d411556d8879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:37.080095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5b7df036-f0ab-40ee-8960-d411556d8879 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:37.081659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5b7df036-f0ab-40ee-8960-d411556d8879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:37.147807 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 497/984] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:37.171104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7a772-2db8-4c19-bf8c-6b11db840ebe None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:37.281742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7a772-2db8-4c19-bf8c-6b11db840ebe None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:37.318226 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f1266-0531-4f39-acd1-c15a29507d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:37.319033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f1266-0531-4f39-acd1-c15a29507d90 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:37.319401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f1266-0531-4f39-acd1-c15a29507d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:37.319814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f1266-0531-4f39-acd1-c15a29507d90 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:37.320689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f1266-0531-4f39-acd1-c15a29507d90 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:37.323163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f1266-0531-4f39-acd1-c15a29507d90 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-5d9f1266-0531-4f39-acd1-c15a29507d90 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:37.337131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:37.338423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 20:18:37.339368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:37.341368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 488/985] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:37.344824 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df036-f0ab-40ee-8960-d411556d8879 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:37.453193 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df036-f0ab-40ee-8960-d411556d8879 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:37.486726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdfcd9-0d15-4906-a035-1a32b525279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:37.487400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdfcd9-0d15-4906-a035-1a32b525279f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:37.487686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdfcd9-0d15-4906-a035-1a32b525279f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:37.487966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdfcd9-0d15-4906-a035-1a32b525279f None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:37.488677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdfcd9-0d15-4906-a035-1a32b525279f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:37.488984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdfcd9-0d15-4906-a035-1a32b525279f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:37.490397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdfcd9-0d15-4906-a035-1a32b525279f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:37.498087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 498/986] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:37.501528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f1266-0531-4f39-acd1-c15a29507d90 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:37.596906 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f1266-0531-4f39-acd1-c15a29507d90 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:37.632717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42c8b1-6032-4ba7-ad26-0f157b7f32fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:37.633448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42c8b1-6032-4ba7-ad26-0f157b7f32fb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:37.633818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42c8b1-6032-4ba7-ad26-0f157b7f32fb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:37.634097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42c8b1-6032-4ba7-ad26-0f157b7f32fb None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:37.634812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42c8b1-6032-4ba7-ad26-0f157b7f32fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:37.635119 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42c8b1-6032-4ba7-ad26-0f157b7f32fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:37.636491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42c8b1-6032-4ba7-ad26-0f157b7f32fb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:37.641917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 489/987] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:37.648078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdfcd9-0d15-4906-a035-1a32b525279f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:37.750543 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdfcd9-0d15-4906-a035-1a32b525279f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:37.786361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859a9e2-5c28-423e-914c-66768ed93cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:37.787148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859a9e2-5c28-423e-914c-66768ed93cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:37.787452 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859a9e2-5c28-423e-914c-66768ed93cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:37.787758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859a9e2-5c28-423e-914c-66768ed93cf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:37.788560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859a9e2-5c28-423e-914c-66768ed93cf4 None admin] RBAC: Adding query filter params (interface=public, service_id=49cd1827f29b4f8cacbb743e8b19aad7, region_id=RegionOne) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:37.788869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859a9e2-5c28-423e-914c-66768ed93cf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:37.790303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859a9e2-5c28-423e-914c-66768ed93cf4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:37.795305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fe6d-446c-4fda-af59-e3c65fb378b9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:37.795588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fe6d-446c-4fda-af59-e3c65fb378b9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:37.795874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fe6d-446c-4fda-af59-e3c65fb378b9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:37.797236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 490/988] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:37.799825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 499/989] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 12 20:18:37 2022] GET /identity/v3/endpoints?service_id=49cd1827f29b4f8cacbb743e8b19aad7&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:37.803628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2c06a-c965-4211-9788-8dd10e9f668d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:37.803915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2c06a-c965-4211-9788-8dd10e9f668d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:37.804822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2c06a-c965-4211-9788-8dd10e9f668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:37.806360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859a9e2-5c28-423e-914c-66768ed93cf4 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:37.822982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e2a2c06a-c965-4211-9788-8dd10e9f668d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:37.824198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e2a2c06a-c965-4211-9788-8dd10e9f668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:37.897657 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 491/990] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:37.917825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2c06a-c965-4211-9788-8dd10e9f668d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:37.937102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859a9e2-5c28-423e-914c-66768ed93cf4 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:37.985192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effaf9b3-7ad6-49ff-a5f2-ee68a86ec299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:37.985935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaf9b3-7ad6-49ff-a5f2-ee68a86ec299 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:37.986223 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaf9b3-7ad6-49ff-a5f2-ee68a86ec299 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:37.986506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effaf9b3-7ad6-49ff-a5f2-ee68a86ec299 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:37.987205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effaf9b3-7ad6-49ff-a5f2-ee68a86ec299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:37.989184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effaf9b3-7ad6-49ff-a5f2-ee68a86ec299 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:37.996065 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 500/991] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 12 20:18:37 2022] GET /identity/v3/services => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:18:38.039463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2c06a-c965-4211-9788-8dd10e9f668d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:38.078903 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4322e-0af7-47e3-90ad-795328ac0fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:38.079760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4322e-0af7-47e3-90ad-795328ac0fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:38.080044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4322e-0af7-47e3-90ad-795328ac0fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:38.080321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4322e-0af7-47e3-90ad-795328ac0fc2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:38.080986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4322e-0af7-47e3-90ad-795328ac0fc2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:38.083414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4322e-0af7-47e3-90ad-795328ac0fc2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-26d4322e-0af7-47e3-90ad-795328ac0fc2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:38.096549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:38.097753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:38.098628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:38.099381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 492/992] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:38.104483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effaf9b3-7ad6-49ff-a5f2-ee68a86ec299 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:38.219495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effaf9b3-7ad6-49ff-a5f2-ee68a86ec299 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:38.271399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6c6b0-2c15-45af-aa3a-6ee85fb0c263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:38.272088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6c6b0-2c15-45af-aa3a-6ee85fb0c263 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:38.272372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6c6b0-2c15-45af-aa3a-6ee85fb0c263 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:38.272649 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6c6b0-2c15-45af-aa3a-6ee85fb0c263 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:38.273404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6c6b0-2c15-45af-aa3a-6ee85fb0c263 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:38.273715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6c6b0-2c15-45af-aa3a-6ee85fb0c263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:38.275198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6c6b0-2c15-45af-aa3a-6ee85fb0c263 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:38.280578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 501/993] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 12 20:18:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:38.286942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4322e-0af7-47e3-90ad-795328ac0fc2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:38.391236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4322e-0af7-47e3-90ad-795328ac0fc2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:38.408730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ff74-03ec-48d5-80a9-49658cc1c42b None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:38.409078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ff74-03ec-48d5-80a9-49658cc1c42b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:38.409345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ff74-03ec-48d5-80a9-49658cc1c42b None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:38.411048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 502/994] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:38.416825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d678f-75e9-4a4f-8475-e278b33acb29 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:38.417114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d678f-75e9-4a4f-8475-e278b33acb29 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:38.417417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d678f-75e9-4a4f-8475-e278b33acb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:38.424846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a2ad-ad9d-45fa-b7d6-ac62eab5e3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:38.425550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a2ad-ad9d-45fa-b7d6-ac62eab5e3fa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:38.426438 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a2ad-ad9d-45fa-b7d6-ac62eab5e3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:38.426617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a2ad-ad9d-45fa-b7d6-ac62eab5e3fa None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:38.427327 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0a2ad-ad9d-45fa-b7d6-ac62eab5e3fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:38.427800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0a2ad-ad9d-45fa-b7d6-ac62eab5e3fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:38.429160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0a2ad-ad9d-45fa-b7d6-ac62eab5e3fa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:38.434327 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 493/995] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 12 20:18:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:38.436070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-bf1d678f-75e9-4a4f-8475-e278b33acb29 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:38.437267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bf1d678f-75e9-4a4f-8475-e278b33acb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:38.440107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a2ad-ad9d-45fa-b7d6-ac62eab5e3fa None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:38.508400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 503/996] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:38.530245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d678f-75e9-4a4f-8475-e278b33acb29 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:38.543374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a2ad-ad9d-45fa-b7d6-ac62eab5e3fa None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:38.581382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995cba-02e6-4985-8bc2-bd81b1888cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:38.582077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995cba-02e6-4985-8bc2-bd81b1888cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:38.582535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995cba-02e6-4985-8bc2-bd81b1888cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:38.583011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995cba-02e6-4985-8bc2-bd81b1888cb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:38.584268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c995cba-02e6-4985-8bc2-bd81b1888cb2 None admin] RBAC: Adding query filter params (interface=admin, service_id=9419545ecc2d43db8ce7459814815030, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:38.584569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c995cba-02e6-4985-8bc2-bd81b1888cb2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:38.586002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c995cba-02e6-4985-8bc2-bd81b1888cb2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:38.593308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 494/997] 10.222.0.59 () {56 vars in 1249 bytes} [Thu May 12 20:18:38 2022] GET /identity/v3/endpoints?service_id=9419545ecc2d43db8ce7459814815030&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:38.597456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995cba-02e6-4985-8bc2-bd81b1888cb2 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:38.645537 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d678f-75e9-4a4f-8475-e278b33acb29 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:38.682672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c537e75-7f5f-433d-ac34-76c443cf06dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:38.683471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537e75-7f5f-433d-ac34-76c443cf06dc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:38.683754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537e75-7f5f-433d-ac34-76c443cf06dc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:38.684033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c537e75-7f5f-433d-ac34-76c443cf06dc None admin] PATH_INFO: `/v3/services/image` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:38.684681 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c537e75-7f5f-433d-ac34-76c443cf06dc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:38.686068 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c537e75-7f5f-433d-ac34-76c443cf06dc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-0c537e75-7f5f-433d-ac34-76c443cf06dc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:38.698204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:38.699246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:38.700128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 504/998] 10.222.0.59 () {56 vars in 1105 bytes} [Thu May 12 20:18:38 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:38.704675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995cba-02e6-4985-8bc2-bd81b1888cb2 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:38.705402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c537e75-7f5f-433d-ac34-76c443cf06dc None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:38.741040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf1a7b-8dbc-42a2-bf1e-4da5d2795761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:38.741755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf1a7b-8dbc-42a2-bf1e-4da5d2795761 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:38.742045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf1a7b-8dbc-42a2-bf1e-4da5d2795761 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:38.742331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf1a7b-8dbc-42a2-bf1e-4da5d2795761 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:38.743025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf1a7b-8dbc-42a2-bf1e-4da5d2795761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:38.744665 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf1a7b-8dbc-42a2-bf1e-4da5d2795761 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:38.758369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 495/999] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 12 20:18:38 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:18:38.837039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c537e75-7f5f-433d-ac34-76c443cf06dc None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:38.879797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57061b-8079-4df5-9c4e-3a908b18d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:38.880456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57061b-8079-4df5-9c4e-3a908b18d85f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:38.880739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57061b-8079-4df5-9c4e-3a908b18d85f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:38.881011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57061b-8079-4df5-9c4e-3a908b18d85f None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:38.881773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57061b-8079-4df5-9c4e-3a908b18d85f None admin] RBAC: Adding query filter params (name=image) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:38.882082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57061b-8079-4df5-9c4e-3a908b18d85f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:38.883494 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57061b-8079-4df5-9c4e-3a908b18d85f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:38.893815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 505/1000] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:38.895979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf1a7b-8dbc-42a2-bf1e-4da5d2795761 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:39.009821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf1a7b-8dbc-42a2-bf1e-4da5d2795761 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:39.044174 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444587be-0692-490c-9e18-ad3379296e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:39.044847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444587be-0692-490c-9e18-ad3379296e1e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:39.045135 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444587be-0692-490c-9e18-ad3379296e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:39.045479 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444587be-0692-490c-9e18-ad3379296e1e None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:39.046255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444587be-0692-490c-9e18-ad3379296e1e None admin] RBAC: Adding query filter params (type=image) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:39.046571 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444587be-0692-490c-9e18-ad3379296e1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:39.047944 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444587be-0692-490c-9e18-ad3379296e1e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:39.057439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 496/1001] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:40.313033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd888bb4-0f19-4504-a876-0fe1870194b7 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:40.313581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd888bb4-0f19-4504-a876-0fe1870194b7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:40.313581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd888bb4-0f19-4504-a876-0fe1870194b7 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:40.315142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 506/1002] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:40.320992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b742f3-d5f1-472f-9cad-8aececb5e13f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:40.321561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b742f3-d5f1-472f-9cad-8aececb5e13f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:40.321661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b742f3-d5f1-472f-9cad-8aececb5e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:40.339377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-80b742f3-d5f1-472f-9cad-8aececb5e13f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:40.340583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-80b742f3-d5f1-472f-9cad-8aececb5e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:40.409864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 497/1003] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:40.433042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd888bb4-0f19-4504-a876-0fe1870194b7 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:40.541880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd888bb4-0f19-4504-a876-0fe1870194b7 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:40.575344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd27e0-9d39-440d-8e7c-6f948d9301ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:40.576071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd27e0-9d39-440d-8e7c-6f948d9301ce None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:40.576356 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd27e0-9d39-440d-8e7c-6f948d9301ce None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:40.576631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd27e0-9d39-440d-8e7c-6f948d9301ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:40.577310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd27e0-9d39-440d-8e7c-6f948d9301ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:40.578674 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd27e0-9d39-440d-8e7c-6f948d9301ce None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-54fd27e0-9d39-440d-8e7c-6f948d9301ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:40.591252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:40.592314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 20:18:40.593162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:40.597658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 507/1004] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:40.599133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b742f3-d5f1-472f-9cad-8aececb5e13f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:40.699321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b742f3-d5f1-472f-9cad-8aececb5e13f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:40.736542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfd313-551d-4449-b84d-bae3f691a5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:40.736992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfd313-551d-4449-b84d-bae3f691a5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:40.737367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfd313-551d-4449-b84d-bae3f691a5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:40.737582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfd313-551d-4449-b84d-bae3f691a5a3 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:40.738414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfd313-551d-4449-b84d-bae3f691a5a3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:40.738791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfd313-551d-4449-b84d-bae3f691a5a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:40.740231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfd313-551d-4449-b84d-bae3f691a5a3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:40.750107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 498/1005] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:40.751641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd27e0-9d39-440d-8e7c-6f948d9301ce None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:40.857429 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd27e0-9d39-440d-8e7c-6f948d9301ce None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:40.897615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c45e3-cf1c-4ddf-8824-0da509d34782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:40.898290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c45e3-cf1c-4ddf-8824-0da509d34782 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:40.898572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c45e3-cf1c-4ddf-8824-0da509d34782 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:40.898849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c45e3-cf1c-4ddf-8824-0da509d34782 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:40.899565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c45e3-cf1c-4ddf-8824-0da509d34782 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:40.899887 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c45e3-cf1c-4ddf-8824-0da509d34782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:40.901236 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c45e3-cf1c-4ddf-8824-0da509d34782 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:40.911509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 508/1006] 10.222.0.59 () {56 vars in 1112 bytes} [Thu May 12 20:18:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:40.912542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfd313-551d-4449-b84d-bae3f691a5a3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:41.012033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfd313-551d-4449-b84d-bae3f691a5a3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:41.049074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b9670-3fad-4b5f-a20d-6f240caefd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:41.049784 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b9670-3fad-4b5f-a20d-6f240caefd7d None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:41.050073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b9670-3fad-4b5f-a20d-6f240caefd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:41.050354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b9670-3fad-4b5f-a20d-6f240caefd7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:41.051675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b9670-3fad-4b5f-a20d-6f240caefd7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:41.053237 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b9670-3fad-4b5f-a20d-6f240caefd7d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:41.126814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 499/1007] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 12 20:18:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:41.222675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b57c8-800a-4a77-869f-72214d252609 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:41.223605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b57c8-800a-4a77-869f-72214d252609 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:41.223885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b57c8-800a-4a77-869f-72214d252609 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:41.225636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 509/1008] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:41.231295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e77d-3d2e-42fc-949b-0a321143d27a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:41.231578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e77d-3d2e-42fc-949b-0a321143d27a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:41.231873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e77d-3d2e-42fc-949b-0a321143d27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:41.249966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f627e77d-3d2e-42fc-949b-0a321143d27a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:41.251164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f627e77d-3d2e-42fc-949b-0a321143d27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:41.328075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 500/1009] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:41 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:41.353511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f92a5-9dc9-4a84-a2d8-bde0cd4f689d None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:41.354022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f92a5-9dc9-4a84-a2d8-bde0cd4f689d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:41.354125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f92a5-9dc9-4a84-a2d8-bde0cd4f689d None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:41.354200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e77d-3d2e-42fc-949b-0a321143d27a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:41.355558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 510/1010] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:41.360754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df16c6-2ad0-4429-8f4d-673518de3b64 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:41.361044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df16c6-2ad0-4429-8f4d-673518de3b64 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:41.361368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df16c6-2ad0-4429-8f4d-673518de3b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:41.378465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-b5df16c6-2ad0-4429-8f4d-673518de3b64 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:41.380310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b5df16c6-2ad0-4429-8f4d-673518de3b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:41.462040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e77d-3d2e-42fc-949b-0a321143d27a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:41.468278 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 511/1011] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:41 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:41.496368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1f27-cffe-44a2-91d2-8604ff418a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:41.497189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1f27-cffe-44a2-91d2-8604ff418a6d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:41.497509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1f27-cffe-44a2-91d2-8604ff418a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:41.497795 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1f27-cffe-44a2-91d2-8604ff418a6d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:41.498488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1f27-cffe-44a2-91d2-8604ff418a6d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:41.499881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1f27-cffe-44a2-91d2-8604ff418a6d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:41.507278 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df16c6-2ad0-4429-8f4d-673518de3b64 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-68fd1f27-cffe-44a2-91d2-8604ff418a6d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:41.511762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:41.513867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:41.515817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 501/1012] 10.222.0.59 () {56 vars in 1126 bytes} [Thu May 12 20:18:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:41.521140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1f27-cffe-44a2-91d2-8604ff418a6d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:41.614329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df16c6-2ad0-4429-8f4d-673518de3b64 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:41.619741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1f27-cffe-44a2-91d2-8604ff418a6d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:41.648890 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a034cd-784d-41ce-be61-093678251b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:41.649581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a034cd-784d-41ce-be61-093678251b11 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:41.650131 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a034cd-784d-41ce-be61-093678251b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:41.650243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a034cd-784d-41ce-be61-093678251b11 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:41.650904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a034cd-784d-41ce-be61-093678251b11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:41.652303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a034cd-784d-41ce-be61-093678251b11 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:41.654801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bfef5-0f79-461c-bd2b-9795659fb7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:41.655489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bfef5-0f79-461c-bd2b-9795659fb7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:41.655750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bfef5-0f79-461c-bd2b-9795659fb7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:41.656029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bfef5-0f79-461c-bd2b-9795659fb7e4 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:41.656733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bfef5-0f79-461c-bd2b-9795659fb7e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:41.657040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bfef5-0f79-461c-bd2b-9795659fb7e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:41.658429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bfef5-0f79-461c-bd2b-9795659fb7e4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:41.663567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 502/1013] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 12 20:18:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:41.669195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bfef5-0f79-461c-bd2b-9795659fb7e4 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:41.759568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 512/1014] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:18:41 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:18:41.772917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bfef5-0f79-461c-bd2b-9795659fb7e4 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:41.817044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583a03e-9ae0-4c09-b190-7a790af8d7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:41.817776 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583a03e-9ae0-4c09-b190-7a790af8d7de None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:41.818061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583a03e-9ae0-4c09-b190-7a790af8d7de None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:41.818337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583a03e-9ae0-4c09-b190-7a790af8d7de None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:41.819077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583a03e-9ae0-4c09-b190-7a790af8d7de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:41.819388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583a03e-9ae0-4c09-b190-7a790af8d7de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:41.820866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583a03e-9ae0-4c09-b190-7a790af8d7de None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:41.827019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 503/1015] 10.222.0.59 () {56 vars in 1122 bytes} [Thu May 12 20:18:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:41.833800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a034cd-784d-41ce-be61-093678251b11 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:41.971192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a034cd-784d-41ce-be61-093678251b11 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:42.008241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cc182-97a0-4944-b152-6244deed8503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:42.008922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc182-97a0-4944-b152-6244deed8503 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:42.009207 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc182-97a0-4944-b152-6244deed8503 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:42.009573 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc182-97a0-4944-b152-6244deed8503 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:42.010331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cc182-97a0-4944-b152-6244deed8503 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:42.011762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cc182-97a0-4944-b152-6244deed8503 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:42.159367 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 513/1016] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 12 20:18:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:43.554316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e79c5-955c-4a85-bd6d-2c4cbe7ae1a2 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:43.554844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e79c5-955c-4a85-bd6d-2c4cbe7ae1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:43.554947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e79c5-955c-4a85-bd6d-2c4cbe7ae1a2 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:43.556374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 504/1017] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:43.561498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7faf2e-c980-4d40-948e-3fa34e6506a4 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:43.561907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7faf2e-c980-4d40-948e-3fa34e6506a4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:43.562068 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7faf2e-c980-4d40-948e-3fa34e6506a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:43.578986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-2d7faf2e-c980-4d40-948e-3fa34e6506a4 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:43.580192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2d7faf2e-c980-4d40-948e-3fa34e6506a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:43.652779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 514/1018] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:43.676879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e79c5-955c-4a85-bd6d-2c4cbe7ae1a2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:43.777400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e79c5-955c-4a85-bd6d-2c4cbe7ae1a2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:43.812244 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b86051-e50b-4556-8f99-4aa33dc426e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:43.813480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b86051-e50b-4556-8f99-4aa33dc426e9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:43.813979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b86051-e50b-4556-8f99-4aa33dc426e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:43.814506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b86051-e50b-4556-8f99-4aa33dc426e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:43.827597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b86051-e50b-4556-8f99-4aa33dc426e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-b2b86051-e50b-4556-8f99-4aa33dc426e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:43.841645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:43.842603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:43.843449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:43.844728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 505/1019] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 12 20:18:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:43.852337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7faf2e-c980-4d40-948e-3fa34e6506a4 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:43.990838 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7faf2e-c980-4d40-948e-3fa34e6506a4 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.024697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608b92f-015d-42fe-aee6-a838b19ad500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.025403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608b92f-015d-42fe-aee6-a838b19ad500 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.025807 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608b92f-015d-42fe-aee6-a838b19ad500 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.026097 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608b92f-015d-42fe-aee6-a838b19ad500 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.026855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608b92f-015d-42fe-aee6-a838b19ad500 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:44.027166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608b92f-015d-42fe-aee6-a838b19ad500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:44.028527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608b92f-015d-42fe-aee6-a838b19ad500 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:44.037909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 515/1020] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 12 20:18:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:44.043248 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b86051-e50b-4556-8f99-4aa33dc426e9 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.111408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec2c86-8de2-4061-96cb-dc009bf8fd17 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.111702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec2c86-8de2-4061-96cb-dc009bf8fd17 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.112148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec2c86-8de2-4061-96cb-dc009bf8fd17 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.114867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 516/1021] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:44.120532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b764-4956-418a-bae7-a2c15ac5a183 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.120827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b764-4956-418a-bae7-a2c15ac5a183 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.121107 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b764-4956-418a-bae7-a2c15ac5a183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.138129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-62a7b764-4956-418a-bae7-a2c15ac5a183 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:44.139321 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-62a7b764-4956-418a-bae7-a2c15ac5a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:44.144227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b86051-e50b-4556-8f99-4aa33dc426e9 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.192164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9cf0-0742-4d94-8ef5-47ca73bb059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.192750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9cf0-0742-4d94-8ef5-47ca73bb059c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.193037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9cf0-0742-4d94-8ef5-47ca73bb059c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.193339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9cf0-0742-4d94-8ef5-47ca73bb059c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.205150 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9cf0-0742-4d94-8ef5-47ca73bb059c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:44.206697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9cf0-0742-4d94-8ef5-47ca73bb059c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:44.218161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 517/1022] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-523a9cf0-0742-4d94-8ef5-47ca73bb059c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:44.226928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:44.227843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:44.230149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:44.230149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:44.230149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:44.230149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:44.230149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 506/1023] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:44.233805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7b764-4956-418a-bae7-a2c15ac5a183 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.241416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9cf0-0742-4d94-8ef5-47ca73bb059c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.353257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9cf0-0742-4d94-8ef5-47ca73bb059c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.354120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7b764-4956-418a-bae7-a2c15ac5a183 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.387113 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01181e7-dcc5-4b7d-8c6b-820fdbfd17db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.387837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01181e7-dcc5-4b7d-8c6b-820fdbfd17db None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.388123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01181e7-dcc5-4b7d-8c6b-820fdbfd17db None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.388407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01181e7-dcc5-4b7d-8c6b-820fdbfd17db None admin] PATH_INFO: `/v3/services/image` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.389067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01181e7-dcc5-4b7d-8c6b-820fdbfd17db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:44.389893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435a447-1359-4cfd-aaf6-4c4da7d85c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.390493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01181e7-dcc5-4b7d-8c6b-820fdbfd17db None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:44.391191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435a447-1359-4cfd-aaf6-4c4da7d85c63 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.391686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435a447-1359-4cfd-aaf6-4c4da7d85c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.392163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435a447-1359-4cfd-aaf6-4c4da7d85c63 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.393085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435a447-1359-4cfd-aaf6-4c4da7d85c63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:44.393441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435a447-1359-4cfd-aaf6-4c4da7d85c63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:44.395355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435a447-1359-4cfd-aaf6-4c4da7d85c63 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d01181e7-dcc5-4b7d-8c6b-820fdbfd17db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:44.403474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:44.404455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:44.405424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 507/1024] 10.222.0.59 () {56 vars in 1105 bytes} [Thu May 12 20:18:44 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:44.415493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01181e7-dcc5-4b7d-8c6b-820fdbfd17db None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.415704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 518/1025] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:44.416631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435a447-1359-4cfd-aaf6-4c4da7d85c63 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.508592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01181e7-dcc5-4b7d-8c6b-820fdbfd17db None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.513658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435a447-1359-4cfd-aaf6-4c4da7d85c63 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.544138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fed09-3bb6-42e0-99af-71ba842c4d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.545115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fed09-3bb6-42e0-99af-71ba842c4d89 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.545577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fed09-3bb6-42e0-99af-71ba842c4d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.546026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fed09-3bb6-42e0-99af-71ba842c4d89 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.547028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d25710-ddfc-4880-98a2-2965334da0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.547163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fed09-3bb6-42e0-99af-71ba842c4d89 None admin] RBAC: Adding query filter params (name=image) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:44.547609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fed09-3bb6-42e0-99af-71ba842c4d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:44.547821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d25710-ddfc-4880-98a2-2965334da0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.548111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d25710-ddfc-4880-98a2-2965334da0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.548393 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d25710-ddfc-4880-98a2-2965334da0d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.549756 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fed09-3bb6-42e0-99af-71ba842c4d89 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:44.556173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d25710-ddfc-4880-98a2-2965334da0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:44.557120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 508/1026] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:44.557687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d25710-ddfc-4880-98a2-2965334da0d1 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:44.558864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c692-7b69-488f-845c-32752ba3dadd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.559292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c692-7b69-488f-845c-32752ba3dadd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.559711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c692-7b69-488f-845c-32752ba3dadd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.561978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 509/1027] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:44.563012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40c692-7b69-488f-845c-32752ba3dadd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-a0d25710-ddfc-4880-98a2-2965334da0d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:44.574564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:44.576155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:44.577436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 519/1028] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 12 20:18:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:44.579155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33757d67-7436-42ed-9da7-41a1cfff194d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.579659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33757d67-7436-42ed-9da7-41a1cfff194d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.580145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33757d67-7436-42ed-9da7-41a1cfff194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.597951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-33757d67-7436-42ed-9da7-41a1cfff194d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:44.599343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-33757d67-7436-42ed-9da7-41a1cfff194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:44.663663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 520/1029] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:44.664733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33757d67-7436-42ed-9da7-41a1cfff194d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.667784 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40c692-7b69-488f-845c-32752ba3dadd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.700973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f830a2-0cc9-4b46-991f-6d1cb4156096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.701732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f830a2-0cc9-4b46-991f-6d1cb4156096 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.702023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f830a2-0cc9-4b46-991f-6d1cb4156096 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.702306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f830a2-0cc9-4b46-991f-6d1cb4156096 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.703014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f830a2-0cc9-4b46-991f-6d1cb4156096 None admin] RBAC: Adding query filter params (type=image) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:44.703325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f830a2-0cc9-4b46-991f-6d1cb4156096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:44.704678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f830a2-0cc9-4b46-991f-6d1cb4156096 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:44.710011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 510/1030] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:44.710796 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f830a2-0cc9-4b46-991f-6d1cb4156096 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.763723 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33757d67-7436-42ed-9da7-41a1cfff194d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.796661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500fae3-0d6a-4af9-b4a1-4b88dcffe829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.797440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500fae3-0d6a-4af9-b4a1-4b88dcffe829 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.797655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500fae3-0d6a-4af9-b4a1-4b88dcffe829 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.797926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500fae3-0d6a-4af9-b4a1-4b88dcffe829 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.798776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500fae3-0d6a-4af9-b4a1-4b88dcffe829 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:44.799093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500fae3-0d6a-4af9-b4a1-4b88dcffe829 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:44.800607 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500fae3-0d6a-4af9-b4a1-4b88dcffe829 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:44.805639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f830a2-0cc9-4b46-991f-6d1cb4156096 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.817671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 521/1031] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 12 20:18:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:44.818486 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500fae3-0d6a-4af9-b4a1-4b88dcffe829 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.839311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283a5e0-0d1f-43a9-aa50-806e581967dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.840107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a5e0-0d1f-43a9-aa50-806e581967dc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.840394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a5e0-0d1f-43a9-aa50-806e581967dc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.840674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a5e0-0d1f-43a9-aa50-806e581967dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.841876 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283a5e0-0d1f-43a9-aa50-806e581967dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:44.843307 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283a5e0-0d1f-43a9-aa50-806e581967dc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:44.844910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 511/1032] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:44.845702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283a5e0-0d1f-43a9-aa50-806e581967dc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.914074 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500fae3-0d6a-4af9-b4a1-4b88dcffe829 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.940842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283a5e0-0d1f-43a9-aa50-806e581967dc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:44.947715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84c979-3ca0-4402-8c81-78944e39d60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.948382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84c979-3ca0-4402-8c81-78944e39d60d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.948676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84c979-3ca0-4402-8c81-78944e39d60d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.948951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84c979-3ca0-4402-8c81-78944e39d60d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:44.949779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84c979-3ca0-4402-8c81-78944e39d60d None admin] RBAC: Adding query filter params (interface=public, service_id=bdd5ec4c7d9545fd9ae70088c617c9d9, region_id=RegionOne) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:44.950095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84c979-3ca0-4402-8c81-78944e39d60d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:44.951455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84c979-3ca0-4402-8c81-78944e39d60d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:44.956367 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 522/1033] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 12 20:18:44 2022] GET /identity/v3/endpoints?service_id=bdd5ec4c7d9545fd9ae70088c617c9d9&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:44.957701 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84c979-3ca0-4402-8c81-78944e39d60d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:44.975039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ecf2-18f3-49d1-8b63-3c8acc97ab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:44.975696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ecf2-18f3-49d1-8b63-3c8acc97ab71 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:44.975985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ecf2-18f3-49d1-8b63-3c8acc97ab71 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:44.976267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ecf2-18f3-49d1-8b63-3c8acc97ab71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:45.041392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69ecf2-18f3-49d1-8b63-3c8acc97ab71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:45.042883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69ecf2-18f3-49d1-8b63-3c8acc97ab71 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:45.052871 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84c979-3ca0-4402-8c81-78944e39d60d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:45.086021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaae313-872f-499c-a62b-b1e31654072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:45.086685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaae313-872f-499c-a62b-b1e31654072a None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:45.086971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaae313-872f-499c-a62b-b1e31654072a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:45.087251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaae313-872f-499c-a62b-b1e31654072a None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:45.087964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaae313-872f-499c-a62b-b1e31654072a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:45.089445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaae313-872f-499c-a62b-b1e31654072a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:45.138439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 512/1034] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:18:45.139382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ecf2-18f3-49d1-8b63-3c8acc97ab71 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:45.205353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 523/1035] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:18:44 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:45.206252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaae313-872f-499c-a62b-b1e31654072a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:45.238803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ecf2-18f3-49d1-8b63-3c8acc97ab71 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:45.275934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2740973-ad3d-43bb-b9b8-b5f34b1c7bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:45.276625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2740973-ad3d-43bb-b9b8-b5f34b1c7bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:45.276909 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2740973-ad3d-43bb-b9b8-b5f34b1c7bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:45.277188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2740973-ad3d-43bb-b9b8-b5f34b1c7bd3 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:45.277920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2740973-ad3d-43bb-b9b8-b5f34b1c7bd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:45.279499 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2740973-ad3d-43bb-b9b8-b5f34b1c7bd3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:45.294824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 513/1036] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 12 20:18:45 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:18:45.323232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaae313-872f-499c-a62b-b1e31654072a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:45.362153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a3a6f-6a5d-4ab7-b719-ea7320eccf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:45.363123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a3a6f-6a5d-4ab7-b719-ea7320eccf3e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:45.364020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a3a6f-6a5d-4ab7-b719-ea7320eccf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:45.364374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a3a6f-6a5d-4ab7-b719-ea7320eccf3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:45.377401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a3a6f-6a5d-4ab7-b719-ea7320eccf3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:45.378961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a3a6f-6a5d-4ab7-b719-ea7320eccf3e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-789a3a6f-6a5d-4ab7-b719-ea7320eccf3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:45.404553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:45.405855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:45.407237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:45.407237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:45.407237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:45.407237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:45.407237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 524/1037] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:45.413303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2740973-ad3d-43bb-b9b8-b5f34b1c7bd3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:45.526485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2740973-ad3d-43bb-b9b8-b5f34b1c7bd3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:45.561980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5ce2a-80c4-45f1-81d7-9b5784d1963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:45.562649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5ce2a-80c4-45f1-81d7-9b5784d1963e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:45.562928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5ce2a-80c4-45f1-81d7-9b5784d1963e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:45.563232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5ce2a-80c4-45f1-81d7-9b5784d1963e None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:45.564019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5ce2a-80c4-45f1-81d7-9b5784d1963e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:45.564324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5ce2a-80c4-45f1-81d7-9b5784d1963e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:45.566417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5ce2a-80c4-45f1-81d7-9b5784d1963e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:45.582990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 514/1038] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:45.584718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a3a6f-6a5d-4ab7-b719-ea7320eccf3e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:45.689195 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a3a6f-6a5d-4ab7-b719-ea7320eccf3e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:45.724087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24054b39-2db1-41dc-92c9-bcdc490c3740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:45.724883 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054b39-2db1-41dc-92c9-bcdc490c3740 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:45.725164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054b39-2db1-41dc-92c9-bcdc490c3740 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:45.725467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054b39-2db1-41dc-92c9-bcdc490c3740 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:45.732371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24054b39-2db1-41dc-92c9-bcdc490c3740 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:45.733870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24054b39-2db1-41dc-92c9-bcdc490c3740 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-24054b39-2db1-41dc-92c9-bcdc490c3740 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:45.749484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:45.750431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:45.756788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:45.756788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:45.756788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:45.756788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:45.756788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:45.756788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:45.756788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:45.756788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:45.756788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 525/1039] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:45.758806 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5ce2a-80c4-45f1-81d7-9b5784d1963e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:45.860596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5ce2a-80c4-45f1-81d7-9b5784d1963e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:45.892490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78934edb-07de-4d9b-9f4e-a6a11f5b2f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:45.893165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934edb-07de-4d9b-9f4e-a6a11f5b2f87 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:45.893479 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934edb-07de-4d9b-9f4e-a6a11f5b2f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:45.893756 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934edb-07de-4d9b-9f4e-a6a11f5b2f87 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:45.895286 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78934edb-07de-4d9b-9f4e-a6a11f5b2f87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:45.895699 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78934edb-07de-4d9b-9f4e-a6a11f5b2f87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:45.897145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78934edb-07de-4d9b-9f4e-a6a11f5b2f87 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:45.915443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 515/1040] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:45.916816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24054b39-2db1-41dc-92c9-bcdc490c3740 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:46.016588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24054b39-2db1-41dc-92c9-bcdc490c3740 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:46.050851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aaea0-4748-4dbf-8d6f-c5e16e6c16e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:46.051595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aaea0-4748-4dbf-8d6f-c5e16e6c16e1 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:46.051734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aaea0-4748-4dbf-8d6f-c5e16e6c16e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:46.052004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aaea0-4748-4dbf-8d6f-c5e16e6c16e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:46.052840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115aaea0-4748-4dbf-8d6f-c5e16e6c16e1 None admin] RBAC: Adding query filter params (role.id=36d9055ee9d74c3cb9c5c4c6599dffbd, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=156646eda779439784ddbc7d1fbd5b90) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:46.053155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115aaea0-4748-4dbf-8d6f-c5e16e6c16e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:46.054652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115aaea0-4748-4dbf-8d6f-c5e16e6c16e1 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:46.060332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 526/1041] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:45 2022] GET /identity/v3/role_assignments?user.id=156646eda779439784ddbc7d1fbd5b90&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=36d9055ee9d74c3cb9c5c4c6599dffbd => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:47.566613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3306d-35a9-4bd0-835e-33fd3e464d02 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:47.567419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3306d-35a9-4bd0-835e-33fd3e464d02 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:47.567419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3306d-35a9-4bd0-835e-33fd3e464d02 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:47.568680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 516/1042] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:47.573878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ae3a-b265-40b4-8866-c8192793e498 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:47.574292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ae3a-b265-40b4-8866-c8192793e498 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:47.574469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ae3a-b265-40b4-8866-c8192793e498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:47.591535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-1ae2ae3a-b265-40b4-8866-c8192793e498 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:47.592738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1ae2ae3a-b265-40b4-8866-c8192793e498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:47.600440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ef76f-0249-472e-bacc-e52b4859a9f0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:47.600737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ef76f-0249-472e-bacc-e52b4859a9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:47.601011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ef76f-0249-472e-bacc-e52b4859a9f0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:47.602534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 517/1043] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:47.607587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900a70-a7a3-4fc9-b902-5bcba62e1e0e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:47.607880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900a70-a7a3-4fc9-b902-5bcba62e1e0e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:47.608163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900a70-a7a3-4fc9-b902-5bcba62e1e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:47.624823 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ca900a70-a7a3-4fc9-b902-5bcba62e1e0e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:47.626447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ca900a70-a7a3-4fc9-b902-5bcba62e1e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:47.661304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 527/1044] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:47.685638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2ae3a-b265-40b4-8866-c8192793e498 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:47.696834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 518/1045] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:47.719462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca900a70-a7a3-4fc9-b902-5bcba62e1e0e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:47.787924 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2ae3a-b265-40b4-8866-c8192793e498 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:47.819548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca900a70-a7a3-4fc9-b902-5bcba62e1e0e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:47.824632 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340003b-5afe-4368-9c93-a9137ec4e3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:47.825539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340003b-5afe-4368-9c93-a9137ec4e3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:47.825833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340003b-5afe-4368-9c93-a9137ec4e3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:47.826115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340003b-5afe-4368-9c93-a9137ec4e3d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:47.827466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340003b-5afe-4368-9c93-a9137ec4e3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:47.828979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340003b-5afe-4368-9c93-a9137ec4e3d2 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:47.833567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 528/1046] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:47.837262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340003b-5afe-4368-9c93-a9137ec4e3d2 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:47.855647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed9b5a-cd26-4c6f-978f-d7f0faaa4764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:47.856448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed9b5a-cd26-4c6f-978f-d7f0faaa4764 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:47.856729 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed9b5a-cd26-4c6f-978f-d7f0faaa4764 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:47.857005 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed9b5a-cd26-4c6f-978f-d7f0faaa4764 None admin] PATH_INFO: `/v3/services/image` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:47.860612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed9b5a-cd26-4c6f-978f-d7f0faaa4764 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:47.860612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed9b5a-cd26-4c6f-978f-d7f0faaa4764 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f2ed9b5a-cd26-4c6f-978f-d7f0faaa4764 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:47.873133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:47.874384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 20:18:47.875300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:47.876914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 519/1047] 10.222.0.59 () {56 vars in 1105 bytes} [Thu May 12 20:18:47 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:47.881120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed9b5a-cd26-4c6f-978f-d7f0faaa4764 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:47.939740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340003b-5afe-4368-9c93-a9137ec4e3d2 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:47.976348 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968a2e-f196-4ac7-82e1-c5b77550245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:47.977107 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968a2e-f196-4ac7-82e1-c5b77550245c None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:47.977444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968a2e-f196-4ac7-82e1-c5b77550245c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:47.977724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968a2e-f196-4ac7-82e1-c5b77550245c None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:47.978662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968a2e-f196-4ac7-82e1-c5b77550245c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:47.980379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968a2e-f196-4ac7-82e1-c5b77550245c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:47.993623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed9b5a-cd26-4c6f-978f-d7f0faaa4764 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:48.027083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25637b5-c9ec-448d-bf1d-63715c23b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:48.027756 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25637b5-c9ec-448d-bf1d-63715c23b9fd None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:48.028040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25637b5-c9ec-448d-bf1d-63715c23b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:48.028321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25637b5-c9ec-448d-bf1d-63715c23b9fd None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:48.029042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25637b5-c9ec-448d-bf1d-63715c23b9fd None admin] RBAC: Adding query filter params (name=image) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:48.029376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25637b5-c9ec-448d-bf1d-63715c23b9fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:48.030732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25637b5-c9ec-448d-bf1d-63715c23b9fd None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:48.036103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 520/1048] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:48.041844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25637b5-c9ec-448d-bf1d-63715c23b9fd None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:48.113550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 529/1049] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:18:47 2022] POST /identity/v3/users => generated 285 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:18:48.148433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25637b5-c9ec-448d-bf1d-63715c23b9fd None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:48.189129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1d936-e781-44f8-8506-f0d136f6f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:48.189860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d936-e781-44f8-8506-f0d136f6f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:48.190146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d936-e781-44f8-8506-f0d136f6f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:48.190426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d936-e781-44f8-8506-f0d136f6f8e5 None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:48.191359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1d936-e781-44f8-8506-f0d136f6f8e5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:48.191676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1d936-e781-44f8-8506-f0d136f6f8e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:48.193094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1d936-e781-44f8-8506-f0d136f6f8e5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:48.198919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 521/1050] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:48.204625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968a2e-f196-4ac7-82e1-c5b77550245c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:48.310795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968a2e-f196-4ac7-82e1-c5b77550245c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:48.345635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334b155-1b3f-42e2-8e75-ee15050a4d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:48.346320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334b155-1b3f-42e2-8e75-ee15050a4d97 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:48.346610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334b155-1b3f-42e2-8e75-ee15050a4d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:48.346893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334b155-1b3f-42e2-8e75-ee15050a4d97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:48.348140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334b155-1b3f-42e2-8e75-ee15050a4d97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:48.349262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836189f2-7de1-46cd-8a5f-82b4a948ea26 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:48.349591 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836189f2-7de1-46cd-8a5f-82b4a948ea26 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:48.349711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334b155-1b3f-42e2-8e75-ee15050a4d97 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:48.349897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836189f2-7de1-46cd-8a5f-82b4a948ea26 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:48.351232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 522/1051] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:48.356752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfcc7e-1240-47e8-b430-d097ee173960 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:48.357042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfcc7e-1240-47e8-b430-d097ee173960 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:48.357354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfcc7e-1240-47e8-b430-d097ee173960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:48.377727 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-26dfcc7e-1240-47e8-b430-d097ee173960 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:48.379659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-26dfcc7e-1240-47e8-b430-d097ee173960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:48.445086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 523/1052] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:48.461342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 530/1053] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 12 20:18:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:18:48.468598 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfcc7e-1240-47e8-b430-d097ee173960 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:48.577900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfcc7e-1240-47e8-b430-d097ee173960 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:48.625741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154e7d-c529-47bf-8168-d3e2f7ddec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:48.626607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154e7d-c529-47bf-8168-d3e2f7ddec9e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:48.626892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154e7d-c529-47bf-8168-d3e2f7ddec9e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:48.627170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce154e7d-c529-47bf-8168-d3e2f7ddec9e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:48.639257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce154e7d-c529-47bf-8168-d3e2f7ddec9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ce154e7d-c529-47bf-8168-d3e2f7ddec9e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:48.648606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:48.649879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:48.650741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 524/1054] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 12 20:18:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:48.656982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334b155-1b3f-42e2-8e75-ee15050a4d97 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:48.760447 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334b155-1b3f-42e2-8e75-ee15050a4d97 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:48.793694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe58f6-8980-4378-95b9-d44232aa3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:48.794371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe58f6-8980-4378-95b9-d44232aa3937 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:48.794657 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe58f6-8980-4378-95b9-d44232aa3937 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:48.794934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe58f6-8980-4378-95b9-d44232aa3937 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:48.795677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe58f6-8980-4378-95b9-d44232aa3937 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:48.795984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe58f6-8980-4378-95b9-d44232aa3937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:48.797376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe58f6-8980-4378-95b9-d44232aa3937 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:48.806242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 531/1055] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 12 20:18:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:48.812162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154e7d-c529-47bf-8168-d3e2f7ddec9e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:48.911045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce154e7d-c529-47bf-8168-d3e2f7ddec9e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:48.946151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224df3c9-6a6f-4090-b075-6cbe46d668be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:48.946962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224df3c9-6a6f-4090-b075-6cbe46d668be None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:48.947248 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224df3c9-6a6f-4090-b075-6cbe46d668be None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:48.947524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224df3c9-6a6f-4090-b075-6cbe46d668be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:48.958910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224df3c9-6a6f-4090-b075-6cbe46d668be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:48.960374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224df3c9-6a6f-4090-b075-6cbe46d668be None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-224df3c9-6a6f-4090-b075-6cbe46d668be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:48.978218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:48.979186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:48.980108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:48.980108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:48.980108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:48.980108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:48.980108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 525/1056] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:48.986157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe58f6-8980-4378-95b9-d44232aa3937 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:49.095864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe58f6-8980-4378-95b9-d44232aa3937 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:49.130788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaa2eb-7fce-4dbf-96c7-166b502f5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:49.131459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa2eb-7fce-4dbf-96c7-166b502f5d31 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:49.131748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa2eb-7fce-4dbf-96c7-166b502f5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:49.132028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaa2eb-7fce-4dbf-96c7-166b502f5d31 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:49.132759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeaa2eb-7fce-4dbf-96c7-166b502f5d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:49.133069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeaa2eb-7fce-4dbf-96c7-166b502f5d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:49.134482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeaa2eb-7fce-4dbf-96c7-166b502f5d31 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:49.151122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 532/1057] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:49.152487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224df3c9-6a6f-4090-b075-6cbe46d668be None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:49.256467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224df3c9-6a6f-4090-b075-6cbe46d668be None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:49.291096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee0352-6b1e-4124-b8b1-f9f504a8bd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:49.291908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0352-6b1e-4124-b8b1-f9f504a8bd83 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:49.292191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0352-6b1e-4124-b8b1-f9f504a8bd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:49.292573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee0352-6b1e-4124-b8b1-f9f504a8bd83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:49.302493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee0352-6b1e-4124-b8b1-f9f504a8bd83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:49.303975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee0352-6b1e-4124-b8b1-f9f504a8bd83 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-4dee0352-6b1e-4124-b8b1-f9f504a8bd83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:49.319575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:49.330158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:49.331127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 526/1058] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 12 20:18:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:49.331915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaa2eb-7fce-4dbf-96c7-166b502f5d31 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:49.434889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaa2eb-7fce-4dbf-96c7-166b502f5d31 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:49.468262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb83fff-df2e-4a33-a956-bdf3afae0c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:49.468938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb83fff-df2e-4a33-a956-bdf3afae0c0a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:49.469224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb83fff-df2e-4a33-a956-bdf3afae0c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:49.469529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb83fff-df2e-4a33-a956-bdf3afae0c0a None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:49.470372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb83fff-df2e-4a33-a956-bdf3afae0c0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:49.470683 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb83fff-df2e-4a33-a956-bdf3afae0c0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:49.472214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb83fff-df2e-4a33-a956-bdf3afae0c0a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:49.494291 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 533/1059] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 12 20:18:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:49.495512 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee0352-6b1e-4124-b8b1-f9f504a8bd83 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:49.600743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee0352-6b1e-4124-b8b1-f9f504a8bd83 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:49.633802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ddc0d-1c06-46b6-9a75-4fecad95f3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:49.634622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ddc0d-1c06-46b6-9a75-4fecad95f3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:49.634907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ddc0d-1c06-46b6-9a75-4fecad95f3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:49.635184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ddc0d-1c06-46b6-9a75-4fecad95f3e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:49.647148 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ddc0d-1c06-46b6-9a75-4fecad95f3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:49.648603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ddc0d-1c06-46b6-9a75-4fecad95f3e5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9c8ddc0d-1c06-46b6-9a75-4fecad95f3e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:49.665965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:49.666884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:49.667794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:49.667794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:49.667794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:49.667794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:49.667794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 527/1060] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:49.673842 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb83fff-df2e-4a33-a956-bdf3afae0c0a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:49.774782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb83fff-df2e-4a33-a956-bdf3afae0c0a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:49.809395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b6199-7e9f-4699-9999-ca4d575999a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:49.810081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6199-7e9f-4699-9999-ca4d575999a5 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:49.810352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6199-7e9f-4699-9999-ca4d575999a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:49.810629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6199-7e9f-4699-9999-ca4d575999a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:49.811360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b6199-7e9f-4699-9999-ca4d575999a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:49.811666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b6199-7e9f-4699-9999-ca4d575999a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:49.813035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b6199-7e9f-4699-9999-ca4d575999a5 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:49.829630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 534/1061] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:49.831268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ddc0d-1c06-46b6-9a75-4fecad95f3e5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:49.931473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ddc0d-1c06-46b6-9a75-4fecad95f3e5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:49.976256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91d9ac-2557-49e3-bc7e-c45a62b55ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:49.977055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91d9ac-2557-49e3-bc7e-c45a62b55ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:49.977356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91d9ac-2557-49e3-bc7e-c45a62b55ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:49.977629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91d9ac-2557-49e3-bc7e-c45a62b55ef7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:49.985064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91d9ac-2557-49e3-bc7e-c45a62b55ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:49.986545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91d9ac-2557-49e3-bc7e-c45a62b55ef7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-ad91d9ac-2557-49e3-bc7e-c45a62b55ef7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:50.001581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:50.002532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:50.008815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:50.008815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:50.008815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:50.008815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:50.008815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:50.008815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:50.008815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:50.008815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:50.008815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 528/1062] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:50.009369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b6199-7e9f-4699-9999-ca4d575999a5 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:50.112228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b6199-7e9f-4699-9999-ca4d575999a5 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:50.146330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d55ffe-be87-472a-a3fe-0da52f04d44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:50.146924 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d55ffe-be87-472a-a3fe-0da52f04d44a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:50.147212 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d55ffe-be87-472a-a3fe-0da52f04d44a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:50.147491 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d55ffe-be87-472a-a3fe-0da52f04d44a None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:50.148288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d55ffe-be87-472a-a3fe-0da52f04d44a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:50.148602 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d55ffe-be87-472a-a3fe-0da52f04d44a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:50.150064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d55ffe-be87-472a-a3fe-0da52f04d44a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:50.166854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 535/1063] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:50.168060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91d9ac-2557-49e3-bc7e-c45a62b55ef7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:50.268720 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91d9ac-2557-49e3-bc7e-c45a62b55ef7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:50.302467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b9aad-f67b-4599-a8e5-237d92c4f3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:50.303365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b9aad-f67b-4599-a8e5-237d92c4f3e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:50.303654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b9aad-f67b-4599-a8e5-237d92c4f3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:50.303934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b9aad-f67b-4599-a8e5-237d92c4f3e6 None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/156646eda779439784ddbc7d1fbd5b90/roles/36d9055ee9d74c3cb9c5c4c6599dffbd` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:50.306197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b9aad-f67b-4599-a8e5-237d92c4f3e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=156646eda779439784ddbc7d1fbd5b90, role_id=36d9055ee9d74c3cb9c5c4c6599dffbd)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:50.307640 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b9aad-f67b-4599-a8e5-237d92c4f3e6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:50.415118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 529/1064] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:18:50 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/156646eda779439784ddbc7d1fbd5b90/roles/36d9055ee9d74c3cb9c5c4c6599dffbd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:18:50.422710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717c62-17d5-412a-90d2-1c7280e1cc74 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:50.423041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717c62-17d5-412a-90d2-1c7280e1cc74 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:50.423285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717c62-17d5-412a-90d2-1c7280e1cc74 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:50.424863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 536/1065] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:50.431551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f426-3a6a-4fdf-81e3-2a3ed301a1fa None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:50.431872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f426-3a6a-4fdf-81e3-2a3ed301a1fa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:50.432121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f426-3a6a-4fdf-81e3-2a3ed301a1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:50.451030 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1481f426-3a6a-4fdf-81e3-2a3ed301a1fa None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:50.452308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1481f426-3a6a-4fdf-81e3-2a3ed301a1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:50.524217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 530/1066] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:50.547596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6717c62-17d5-412a-90d2-1c7280e1cc74 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:50.682257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6717c62-17d5-412a-90d2-1c7280e1cc74 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:50.715432 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeeeec-db58-4f7a-9b50-605a88b2fe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:50.716227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeeeec-db58-4f7a-9b50-605a88b2fe3a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:50.716508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeeeec-db58-4f7a-9b50-605a88b2fe3a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:50.716781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeeeec-db58-4f7a-9b50-605a88b2fe3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:50.727450 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeeeec-db58-4f7a-9b50-605a88b2fe3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-5feeeeec-db58-4f7a-9b50-605a88b2fe3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:50.734969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:50.735886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:50.736747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:50.741348 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 537/1067] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:50.743112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481f426-3a6a-4fdf-81e3-2a3ed301a1fa None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:50.756196 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880f9cd-8040-4a67-83be-66fb177b052f None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:50.756510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880f9cd-8040-4a67-83be-66fb177b052f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:50.756768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880f9cd-8040-4a67-83be-66fb177b052f None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:50.758235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 538/1068] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:50.763323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8260e-8a37-496d-8b42-7b305105bfb3 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:50.763609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8260e-8a37-496d-8b42-7b305105bfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:50.763886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8260e-8a37-496d-8b42-7b305105bfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:50.780393 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-26c8260e-8a37-496d-8b42-7b305105bfb3 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:50.781671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-26c8260e-8a37-496d-8b42-7b305105bfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:50.844124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481f426-3a6a-4fdf-81e3-2a3ed301a1fa None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:50.849736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 539/1069] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:50.872459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8260e-8a37-496d-8b42-7b305105bfb3 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:50.880792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229fb87-e860-4911-a2dd-02689d96dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:50.881575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229fb87-e860-4911-a2dd-02689d96dbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:50.881863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229fb87-e860-4911-a2dd-02689d96dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:50.882140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229fb87-e860-4911-a2dd-02689d96dbb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:50.882895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229fb87-e860-4911-a2dd-02689d96dbb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:50.883205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229fb87-e860-4911-a2dd-02689d96dbb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:50.884574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229fb87-e860-4911-a2dd-02689d96dbb6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:50.892988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 531/1070] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:50.899347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229fb87-e860-4911-a2dd-02689d96dbb6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:50.978870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8260e-8a37-496d-8b42-7b305105bfb3 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:51.005408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229fb87-e860-4911-a2dd-02689d96dbb6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:51.016912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547b22b-5fbc-4b3a-81b2-8da034f0b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:51.016912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547b22b-5fbc-4b3a-81b2-8da034f0b441 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:51.016912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547b22b-5fbc-4b3a-81b2-8da034f0b441 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:51.016912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547b22b-5fbc-4b3a-81b2-8da034f0b441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:51.043110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd164-4f86-4b11-a298-064d3b89f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:51.044013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd164-4f86-4b11-a298-064d3b89f307 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:51.044417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd164-4f86-4b11-a298-064d3b89f307 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:51.044653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecd164-4f86-4b11-a298-064d3b89f307 None admin] PATH_INFO: `/v3/users/93f560fe7cf3401d8ef152504fb2e4b0` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:51.060526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecd164-4f86-4b11-a298-064d3b89f307 None admin] RBAC: Authorizing `identity:get_user(user_id=93f560fe7cf3401d8ef152504fb2e4b0)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:51.062116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecd164-4f86-4b11-a298-064d3b89f307 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:51.064268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 532/1071] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:18:50 2022] GET /identity/v3/users/93f560fe7cf3401d8ef152504fb2e4b0 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:51.070642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd164-4f86-4b11-a298-064d3b89f307 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:51.086615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547b22b-5fbc-4b3a-81b2-8da034f0b441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:51.088021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547b22b-5fbc-4b3a-81b2-8da034f0b441 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:51.168855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecd164-4f86-4b11-a298-064d3b89f307 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:51.189470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 540/1072] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 20:18:51.192038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547b22b-5fbc-4b3a-81b2-8da034f0b441 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:51.207867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be670b8-ba88-43ff-94eb-93b210aec806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:51.208529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be670b8-ba88-43ff-94eb-93b210aec806 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:51.208815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be670b8-ba88-43ff-94eb-93b210aec806 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:51.209095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be670b8-ba88-43ff-94eb-93b210aec806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:51.277220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be670b8-ba88-43ff-94eb-93b210aec806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:51.278630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be670b8-ba88-43ff-94eb-93b210aec806 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:51.289144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547b22b-5fbc-4b3a-81b2-8da034f0b441 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:51.322964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f73711-c172-4b18-a028-9a0d24d5927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:51.323762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f73711-c172-4b18-a028-9a0d24d5927f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:51.324044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f73711-c172-4b18-a028-9a0d24d5927f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:51.324319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f73711-c172-4b18-a028-9a0d24d5927f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:51.334564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f73711-c172-4b18-a028-9a0d24d5927f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:51.336159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f73711-c172-4b18-a028-9a0d24d5927f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-18f73711-c172-4b18-a028-9a0d24d5927f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:51.353669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:51.354746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:51.355644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:51.355644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:51.355644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:51.355644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:51.355644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 541/1073] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:51.360706 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f73711-c172-4b18-a028-9a0d24d5927f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:51.380291 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 533/1074] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 20:18:51.386029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be670b8-ba88-43ff-94eb-93b210aec806 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:51.458409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f73711-c172-4b18-a028-9a0d24d5927f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:51.489072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be670b8-ba88-43ff-94eb-93b210aec806 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:51.496265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241b2f0-8db3-456e-a578-f4507ce605b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:51.496943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241b2f0-8db3-456e-a578-f4507ce605b4 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:51.497232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241b2f0-8db3-456e-a578-f4507ce605b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:51.497566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241b2f0-8db3-456e-a578-f4507ce605b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:51.498309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241b2f0-8db3-456e-a578-f4507ce605b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:51.498617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241b2f0-8db3-456e-a578-f4507ce605b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:51.500042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241b2f0-8db3-456e-a578-f4507ce605b4 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:51.512439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 542/1075] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:51.527579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961d8ae-d309-446b-890c-34f85c3b2760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:51.528728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961d8ae-d309-446b-890c-34f85c3b2760 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:51.529180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961d8ae-d309-446b-890c-34f85c3b2760 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:51.529650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961d8ae-d309-446b-890c-34f85c3b2760 None admin] PATH_INFO: `/v3/projects/11f19c61611a40218309308cf40e111d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:51.531158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961d8ae-d309-446b-890c-34f85c3b2760 None admin] RBAC: Authorizing `identity:get_project(project_id=11f19c61611a40218309308cf40e111d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:51.532813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961d8ae-d309-446b-890c-34f85c3b2760 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:51.540980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 534/1076] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:18:51 2022] GET /identity/v3/projects/11f19c61611a40218309308cf40e111d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:51.546644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241b2f0-8db3-456e-a578-f4507ce605b4 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:51.654831 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241b2f0-8db3-456e-a578-f4507ce605b4 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:51.690494 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1087e9d-c8af-4714-b965-154d55622f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:51.691345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1087e9d-c8af-4714-b965-154d55622f82 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:51.691648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1087e9d-c8af-4714-b965-154d55622f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:51.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1087e9d-c8af-4714-b965-154d55622f82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:51.692863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1087e9d-c8af-4714-b965-154d55622f82 None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=11f19c61611a40218309308cf40e111d, user.id=93f560fe7cf3401d8ef152504fb2e4b0) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:51.693061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1087e9d-c8af-4714-b965-154d55622f82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:51.694525 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1087e9d-c8af-4714-b965-154d55622f82 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:51.700380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 543/1077] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:51 2022] GET /identity/v3/role_assignments?user.id=93f560fe7cf3401d8ef152504fb2e4b0&scope.project.id=11f19c61611a40218309308cf40e111d&role.id=4ae0665802b946be870ab06274297a1d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:52.716373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01dcf-fd1e-447a-b162-e3e9d1c825bb None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:52.716916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01dcf-fd1e-447a-b162-e3e9d1c825bb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:52.716916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f01dcf-fd1e-447a-b162-e3e9d1c825bb None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:52.718317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 535/1078] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:52.724088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3162e-55c8-4948-9720-36171cb6a005 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:52.724720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3162e-55c8-4948-9720-36171cb6a005 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:52.724720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3162e-55c8-4948-9720-36171cb6a005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:52.747572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-7cb3162e-55c8-4948-9720-36171cb6a005 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:52.748825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7cb3162e-55c8-4948-9720-36171cb6a005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:52.828071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 544/1079] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:52.857549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01dcf-fd1e-447a-b162-e3e9d1c825bb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:52.983577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f01dcf-fd1e-447a-b162-e3e9d1c825bb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:53.030791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95c4e3-2d56-492e-907e-979fe9f9c3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:53.032119 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95c4e3-2d56-492e-907e-979fe9f9c3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:53.032613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95c4e3-2d56-492e-907e-979fe9f9c3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:53.033083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95c4e3-2d56-492e-907e-979fe9f9c3f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:53.046067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95c4e3-2d56-492e-907e-979fe9f9c3f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-4d95c4e3-2d56-492e-907e-979fe9f9c3f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:53.057890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:53.059275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:53.060370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 536/1080] 10.222.0.59 () {56 vars in 1120 bytes} [Thu May 12 20:18:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:53.065374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3162e-55c8-4948-9720-36171cb6a005 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:53.179819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3162e-55c8-4948-9720-36171cb6a005 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:53.218334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c3d32-3038-4ac6-a749-91ea3a27b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:53.219227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c3d32-3038-4ac6-a749-91ea3a27b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:53.219742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c3d32-3038-4ac6-a749-91ea3a27b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:53.220105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c3d32-3038-4ac6-a749-91ea3a27b1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:53.220865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c3d32-3038-4ac6-a749-91ea3a27b1f0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:53.221178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c3d32-3038-4ac6-a749-91ea3a27b1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:53.223367 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c3d32-3038-4ac6-a749-91ea3a27b1f0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:53.232574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 545/1081] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 12 20:18:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:53.238561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95c4e3-2d56-492e-907e-979fe9f9c3f6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:53.346242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95c4e3-2d56-492e-907e-979fe9f9c3f6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:53.378593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6653a3-2dd7-4b12-9238-048b0d6fdf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:53.379391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6653a3-2dd7-4b12-9238-048b0d6fdf5e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:53.379677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6653a3-2dd7-4b12-9238-048b0d6fdf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:53.379957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6653a3-2dd7-4b12-9238-048b0d6fdf5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:53.390122 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6653a3-2dd7-4b12-9238-048b0d6fdf5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:53.391562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6653a3-2dd7-4b12-9238-048b0d6fdf5e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-bf6653a3-2dd7-4b12-9238-048b0d6fdf5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:53.408607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:53.410249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:53.411358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:53.411358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:53.411358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:53.411358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:53.413439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 537/1082] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:53.416004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c3d32-3038-4ac6-a749-91ea3a27b1f0 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:53.532328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c3d32-3038-4ac6-a749-91ea3a27b1f0 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:53.569578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9f43a-cf77-413b-a01f-6e6c27644b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:53.570250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9f43a-cf77-413b-a01f-6e6c27644b25 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:53.570538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9f43a-cf77-413b-a01f-6e6c27644b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:53.570818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9f43a-cf77-413b-a01f-6e6c27644b25 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:53.571546 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9f43a-cf77-413b-a01f-6e6c27644b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:53.571859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9f43a-cf77-413b-a01f-6e6c27644b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:53.573234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9f43a-cf77-413b-a01f-6e6c27644b25 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:53.585816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 546/1083] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:53.591356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6653a3-2dd7-4b12-9238-048b0d6fdf5e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:53.687305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6653a3-2dd7-4b12-9238-048b0d6fdf5e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:53.719893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9659699-dd2c-4a63-88d0-bee3ba41e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:53.720686 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9659699-dd2c-4a63-88d0-bee3ba41e78c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:53.720971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9659699-dd2c-4a63-88d0-bee3ba41e78c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:53.721250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9659699-dd2c-4a63-88d0-bee3ba41e78c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:53.728577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9659699-dd2c-4a63-88d0-bee3ba41e78c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:53.730048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9659699-dd2c-4a63-88d0-bee3ba41e78c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-c9659699-dd2c-4a63-88d0-bee3ba41e78c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:18:53.743594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:53.744882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:53.745917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 538/1084] 10.222.0.59 () {56 vars in 1093 bytes} [Thu May 12 20:18:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:53.750694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9f43a-cf77-413b-a01f-6e6c27644b25 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:53.857770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9f43a-cf77-413b-a01f-6e6c27644b25 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:53.892149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a054a6-e940-4910-bee0-cdf534372124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:53.892818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a054a6-e940-4910-bee0-cdf534372124 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:53.893109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a054a6-e940-4910-bee0-cdf534372124 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:53.893421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a054a6-e940-4910-bee0-cdf534372124 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:53.894839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a054a6-e940-4910-bee0-cdf534372124 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:53.895146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a054a6-e940-4910-bee0-cdf534372124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:53.896567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a054a6-e940-4910-bee0-cdf534372124 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:53.912943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 547/1085] 10.222.0.59 () {56 vars in 1133 bytes} [Thu May 12 20:18:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:53.920111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9659699-dd2c-4a63-88d0-bee3ba41e78c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:53.959346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2443a-02ee-4e1a-bc01-71ac87e554ad None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:53.959638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2443a-02ee-4e1a-bc01-71ac87e554ad None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:53.959925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2443a-02ee-4e1a-bc01-71ac87e554ad None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:53.961300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 548/1086] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:18:53.966206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd722a6-d268-4300-9d3c-5faaa0c11836 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:53.966494 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd722a6-d268-4300-9d3c-5faaa0c11836 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:53.966775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd722a6-d268-4300-9d3c-5faaa0c11836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:53.982836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-fcd722a6-d268-4300-9d3c-5faaa0c11836 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:53.984006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-fcd722a6-d268-4300-9d3c-5faaa0c11836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:54.016295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9659699-dd2c-4a63-88d0-bee3ba41e78c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.049039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257079a3-8480-4a3b-833d-0a254a2bbd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.049714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257079a3-8480-4a3b-833d-0a254a2bbd17 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.050542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257079a3-8480-4a3b-833d-0a254a2bbd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.050947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257079a3-8480-4a3b-833d-0a254a2bbd17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.051392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 549/1087] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:18:54.074744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd722a6-d268-4300-9d3c-5faaa0c11836 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:54.117531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257079a3-8480-4a3b-833d-0a254a2bbd17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:54.119196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257079a3-8480-4a3b-833d-0a254a2bbd17 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:54.168638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd722a6-d268-4300-9d3c-5faaa0c11836 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.201993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c2cac-a8e1-43c5-a87e-d4ed6ce364b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.202785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2cac-a8e1-43c5-a87e-d4ed6ce364b8 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.203070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2cac-a8e1-43c5-a87e-d4ed6ce364b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.203351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2cac-a8e1-43c5-a87e-d4ed6ce364b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.211710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 539/1088] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:18:54.214090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c2cac-a8e1-43c5-a87e-d4ed6ce364b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:54.217218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257079a3-8480-4a3b-833d-0a254a2bbd17 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-2d9c2cac-a8e1-43c5-a87e-d4ed6ce364b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:54.222553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:54.223766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:54.224645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 550/1089] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:54.229671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c2cac-a8e1-43c5-a87e-d4ed6ce364b8 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:54.311852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257079a3-8480-4a3b-833d-0a254a2bbd17 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.324649 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c2cac-a8e1-43c5-a87e-d4ed6ce364b8 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.345193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afe602-1632-4a78-a9fd-1814ea79d3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.346010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe602-1632-4a78-a9fd-1814ea79d3ba None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.346299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe602-1632-4a78-a9fd-1814ea79d3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.346581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe602-1632-4a78-a9fd-1814ea79d3ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.356503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afe602-1632-4a78-a9fd-1814ea79d3ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:54.357498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8adab-a8b8-49b1-bc32-bcea324a1473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.357972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afe602-1632-4a78-a9fd-1814ea79d3ba None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:54.358168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8adab-a8b8-49b1-bc32-bcea324a1473 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.358455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8adab-a8b8-49b1-bc32-bcea324a1473 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.358736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8adab-a8b8-49b1-bc32-bcea324a1473 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.359480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8adab-a8b8-49b1-bc32-bcea324a1473 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:54.359790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8adab-a8b8-49b1-bc32-bcea324a1473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:54.361142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8adab-a8b8-49b1-bc32-bcea324a1473 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:54.369805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 551/1090] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-14afe602-1632-4a78-a9fd-1814ea79d3ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:18:54.375195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:54.376255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:54.377147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:18:54.377147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:18:54.377147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:18:54.377147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:54.377541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8adab-a8b8-49b1-bc32-bcea324a1473 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:54.377630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 540/1091] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 20:18:54.382283 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afe602-1632-4a78-a9fd-1814ea79d3ba None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:54.471761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8adab-a8b8-49b1-bc32-bcea324a1473 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.476559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afe602-1632-4a78-a9fd-1814ea79d3ba None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.504235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5854b7-1021-4b38-bcbb-a0ebab2ac00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.505115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5854b7-1021-4b38-bcbb-a0ebab2ac00b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.505439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5854b7-1021-4b38-bcbb-a0ebab2ac00b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.505721 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5854b7-1021-4b38-bcbb-a0ebab2ac00b None admin] PATH_INFO: `/v3/users/93f560fe7cf3401d8ef152504fb2e4b0` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.506900 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5854b7-1021-4b38-bcbb-a0ebab2ac00b None admin] RBAC: Authorizing `identity:get_user(user_id=93f560fe7cf3401d8ef152504fb2e4b0)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:54.508323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5854b7-1021-4b38-bcbb-a0ebab2ac00b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:54.509519 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79152810-21aa-4896-809e-683c5daf63aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.509986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 552/1092] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:18:54 2022] GET /identity/v3/users/93f560fe7cf3401d8ef152504fb2e4b0 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:54.510188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79152810-21aa-4896-809e-683c5daf63aa None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.510476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79152810-21aa-4896-809e-683c5daf63aa None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.510757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79152810-21aa-4896-809e-683c5daf63aa None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.511484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79152810-21aa-4896-809e-683c5daf63aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:54.511793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79152810-21aa-4896-809e-683c5daf63aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:54.513152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79152810-21aa-4896-809e-683c5daf63aa None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:54.515604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5854b7-1021-4b38-bcbb-a0ebab2ac00b None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:54.525487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 541/1093] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:54.530945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79152810-21aa-4896-809e-683c5daf63aa None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:54.610725 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5854b7-1021-4b38-bcbb-a0ebab2ac00b None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.626553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79152810-21aa-4896-809e-683c5daf63aa None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.645923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fecbff-318b-4fb8-b633-e21f9c83c44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.646757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fecbff-318b-4fb8-b633-e21f9c83c44c None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.647044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fecbff-318b-4fb8-b633-e21f9c83c44c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.647322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fecbff-318b-4fb8-b633-e21f9c83c44c None admin] PATH_INFO: `/v3/projects/11f19c61611a40218309308cf40e111d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.648502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fecbff-318b-4fb8-b633-e21f9c83c44c None admin] RBAC: Authorizing `identity:get_project(project_id=11f19c61611a40218309308cf40e111d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:54.649963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fecbff-318b-4fb8-b633-e21f9c83c44c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:54.651682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 553/1094] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:18:54 2022] GET /identity/v3/projects/11f19c61611a40218309308cf40e111d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:54.658067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fecbff-318b-4fb8-b633-e21f9c83c44c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:54.660244 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c9725-0ac0-4492-ad55-a3ad6e05ce17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.661066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c9725-0ac0-4492-ad55-a3ad6e05ce17 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.661378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c9725-0ac0-4492-ad55-a3ad6e05ce17 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.661659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c9725-0ac0-4492-ad55-a3ad6e05ce17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.669231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c9725-0ac0-4492-ad55-a3ad6e05ce17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:54.670760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c9725-0ac0-4492-ad55-a3ad6e05ce17 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-3a3c9725-0ac0-4492-ad55-a3ad6e05ce17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:18:54.687115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:54.688147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:54.689039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:18:54.689039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:18:54.689039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:18:54.689039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:18:54.689039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:18:54.689039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:18:54.689039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:18:54.689039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:18:54.689039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 542/1095] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:18:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:54.695341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c9725-0ac0-4492-ad55-a3ad6e05ce17 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:54.762404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fecbff-318b-4fb8-b633-e21f9c83c44c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.790258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c9725-0ac0-4492-ad55-a3ad6e05ce17 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.794127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1319a-c624-47a7-ad27-830864de3787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.795019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1319a-c624-47a7-ad27-830864de3787 None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.795305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1319a-c624-47a7-ad27-830864de3787 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.795586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1319a-c624-47a7-ad27-830864de3787 None admin] PATH_INFO: `/v3/projects/11f19c61611a40218309308cf40e111d/users/93f560fe7cf3401d8ef152504fb2e4b0/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.797570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1319a-c624-47a7-ad27-830864de3787 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f19c61611a40218309308cf40e111d, user_id=93f560fe7cf3401d8ef152504fb2e4b0, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:54.798997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1319a-c624-47a7-ad27-830864de3787 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:54.823470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183307a-51de-4071-84cb-7eb131e71cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.824126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183307a-51de-4071-84cb-7eb131e71cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.824411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183307a-51de-4071-84cb-7eb131e71cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.824689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183307a-51de-4071-84cb-7eb131e71cf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.825504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183307a-51de-4071-84cb-7eb131e71cf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:54.825817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183307a-51de-4071-84cb-7eb131e71cf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:54.827244 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183307a-51de-4071-84cb-7eb131e71cf7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:54.838445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 543/1096] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:18:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:54.844366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183307a-51de-4071-84cb-7eb131e71cf7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:54.873577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 554/1097] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:18:54 2022] PUT /identity/v3/projects/11f19c61611a40218309308cf40e111d/users/93f560fe7cf3401d8ef152504fb2e4b0/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:18:54.951882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183307a-51de-4071-84cb-7eb131e71cf7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:54.986540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b88d1-5fa5-4931-9b7a-99dce95d4e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:54.987225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b88d1-5fa5-4931-9b7a-99dce95d4e7b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:54.988028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b88d1-5fa5-4931-9b7a-99dce95d4e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:54.988403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b88d1-5fa5-4931-9b7a-99dce95d4e7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:54.989148 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b88d1-5fa5-4931-9b7a-99dce95d4e7b None admin] RBAC: Adding query filter params (role.id=36d9055ee9d74c3cb9c5c4c6599dffbd, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=156646eda779439784ddbc7d1fbd5b90) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:54.989494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b88d1-5fa5-4931-9b7a-99dce95d4e7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:54.990941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b88d1-5fa5-4931-9b7a-99dce95d4e7b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:54.997673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 544/1098] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:54 2022] GET /identity/v3/role_assignments?user.id=156646eda779439784ddbc7d1fbd5b90&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=36d9055ee9d74c3cb9c5c4c6599dffbd => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:57.136870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28126f-a268-4684-acb2-911fda6694be None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:57.137410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28126f-a268-4684-acb2-911fda6694be None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:57.137410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28126f-a268-4684-acb2-911fda6694be None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:57.138728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 555/1099] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:18:57.143917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8375f17-72ea-43a1-bf84-93ba4fef22eb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:57.144305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8375f17-72ea-43a1-bf84-93ba4fef22eb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:57.144490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8375f17-72ea-43a1-bf84-93ba4fef22eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:57.160957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c8375f17-72ea-43a1-bf84-93ba4fef22eb None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:18:57.162219 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c8375f17-72ea-43a1-bf84-93ba4fef22eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:18:57.232155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 545/1100] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:18:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:18:57.258034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28126f-a268-4684-acb2-911fda6694be None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:57.358743 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28126f-a268-4684-acb2-911fda6694be None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:57.392852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb341f-2f7d-4004-986c-7ad81d97d1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:57.392852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb341f-2f7d-4004-986c-7ad81d97d1ff None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:57.393122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb341f-2f7d-4004-986c-7ad81d97d1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:57.393263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb341f-2f7d-4004-986c-7ad81d97d1ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:57.403756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb341f-2f7d-4004-986c-7ad81d97d1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-79eb341f-2f7d-4004-986c-7ad81d97d1ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:18:57.412031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:18:57.413159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:18:57.414134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 556/1101] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:18:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:18:57.419325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8375f17-72ea-43a1-bf84-93ba4fef22eb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:57.513600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8375f17-72ea-43a1-bf84-93ba4fef22eb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:57.548925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563537be-6656-46b6-8ee4-0ec3c48df776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:57.549634 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563537be-6656-46b6-8ee4-0ec3c48df776 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:57.550477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563537be-6656-46b6-8ee4-0ec3c48df776 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:57.550753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563537be-6656-46b6-8ee4-0ec3c48df776 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:57.551668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563537be-6656-46b6-8ee4-0ec3c48df776 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:57.551982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563537be-6656-46b6-8ee4-0ec3c48df776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:57.553366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563537be-6656-46b6-8ee4-0ec3c48df776 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:57.561381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 546/1102] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:18:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:18:57.567441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb341f-2f7d-4004-986c-7ad81d97d1ff None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:57.665035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb341f-2f7d-4004-986c-7ad81d97d1ff None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:57.697893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a57c3-0ada-4d7f-84a8-1b04a66a8e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:57.698757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a57c3-0ada-4d7f-84a8-1b04a66a8e3a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:57.699039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a57c3-0ada-4d7f-84a8-1b04a66a8e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:57.699314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a57c3-0ada-4d7f-84a8-1b04a66a8e3a None admin] PATH_INFO: `/v3/users/93f560fe7cf3401d8ef152504fb2e4b0` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:57.700492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a57c3-0ada-4d7f-84a8-1b04a66a8e3a None admin] RBAC: Authorizing `identity:get_user(user_id=93f560fe7cf3401d8ef152504fb2e4b0)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:57.701970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a57c3-0ada-4d7f-84a8-1b04a66a8e3a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:57.703597 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 557/1103] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:18:57 2022] GET /identity/v3/users/93f560fe7cf3401d8ef152504fb2e4b0 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:57.710029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563537be-6656-46b6-8ee4-0ec3c48df776 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:57.807913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563537be-6656-46b6-8ee4-0ec3c48df776 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:57.840408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266905d-36c1-4ff8-a98f-b950d01c55b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:57.841056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266905d-36c1-4ff8-a98f-b950d01c55b8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:57.841372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266905d-36c1-4ff8-a98f-b950d01c55b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:57.841657 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266905d-36c1-4ff8-a98f-b950d01c55b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:57.907346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266905d-36c1-4ff8-a98f-b950d01c55b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:57.908796 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266905d-36c1-4ff8-a98f-b950d01c55b8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:58.004704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 547/1104] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:18:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:18:58.010847 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a57c3-0ada-4d7f-84a8-1b04a66a8e3a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:58.110956 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a57c3-0ada-4d7f-84a8-1b04a66a8e3a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:58.145039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f13c98-44ba-485a-9659-00931dfc58d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:58.145956 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f13c98-44ba-485a-9659-00931dfc58d8 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:58.146213 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f13c98-44ba-485a-9659-00931dfc58d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:58.146490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f13c98-44ba-485a-9659-00931dfc58d8 None admin] PATH_INFO: `/v3/projects/11f19c61611a40218309308cf40e111d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:58.147692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f13c98-44ba-485a-9659-00931dfc58d8 None admin] RBAC: Authorizing `identity:get_project(project_id=11f19c61611a40218309308cf40e111d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:58.149122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f13c98-44ba-485a-9659-00931dfc58d8 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:58.150851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 558/1105] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:18:58 2022] GET /identity/v3/projects/11f19c61611a40218309308cf40e111d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:18:58.157079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266905d-36c1-4ff8-a98f-b950d01c55b8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:18:58.253966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266905d-36c1-4ff8-a98f-b950d01c55b8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:18:58.288726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ebefe-b2d9-45a2-aad5-423a57ab1788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:18:58.289312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ebefe-b2d9-45a2-aad5-423a57ab1788 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:18:58.289602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ebefe-b2d9-45a2-aad5-423a57ab1788 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:18:58.289937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ebefe-b2d9-45a2-aad5-423a57ab1788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:18:58.290714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ebefe-b2d9-45a2-aad5-423a57ab1788 None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=11f19c61611a40218309308cf40e111d, user.id=93f560fe7cf3401d8ef152504fb2e4b0) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:18:58.291021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ebefe-b2d9-45a2-aad5-423a57ab1788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:18:58.292463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ebefe-b2d9-45a2-aad5-423a57ab1788 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:18:58.298723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 548/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:18:58 2022] GET /identity/v3/role_assignments?user.id=93f560fe7cf3401d8ef152504fb2e4b0&scope.project.id=11f19c61611a40218309308cf40e111d&role.id=4ae0665802b946be870ab06274297a1d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:00.592775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f531c-fba5-4041-a63d-05da41dc7c57 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:00.593323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f531c-fba5-4041-a63d-05da41dc7c57 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:00.593531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f531c-fba5-4041-a63d-05da41dc7c57 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:00.594745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 559/1107] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:00.600639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a9d7-ad9e-4cff-b2c2-1d2483b67ed0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:00.601115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a9d7-ad9e-4cff-b2c2-1d2483b67ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:00.601219 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a9d7-ad9e-4cff-b2c2-1d2483b67ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:00.619128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c684a9d7-ad9e-4cff-b2c2-1d2483b67ed0 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:00.620301 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c684a9d7-ad9e-4cff-b2c2-1d2483b67ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:00.683553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 549/1108] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:00.708735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f531c-fba5-4041-a63d-05da41dc7c57 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:00.805705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f531c-fba5-4041-a63d-05da41dc7c57 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:00.838400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e3cb9-fee5-4a48-8433-3d9cac6c56bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:00.839203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3cb9-fee5-4a48-8433-3d9cac6c56bd None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:00.839485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3cb9-fee5-4a48-8433-3d9cac6c56bd None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:00.839761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3cb9-fee5-4a48-8433-3d9cac6c56bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:00.840918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e3cb9-fee5-4a48-8433-3d9cac6c56bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:00.842549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e3cb9-fee5-4a48-8433-3d9cac6c56bd None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:00.844185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 560/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:19:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:00.850492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684a9d7-ad9e-4cff-b2c2-1d2483b67ed0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:00.950979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684a9d7-ad9e-4cff-b2c2-1d2483b67ed0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:00.985492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba8c8c-7656-4b95-8739-e718bdeb316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:00.986160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba8c8c-7656-4b95-8739-e718bdeb316f None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:00.986445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba8c8c-7656-4b95-8739-e718bdeb316f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:00.986720 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba8c8c-7656-4b95-8739-e718bdeb316f None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:00.987985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba8c8c-7656-4b95-8739-e718bdeb316f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:00.989805 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba8c8c-7656-4b95-8739-e718bdeb316f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:01.076115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 550/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:19:00 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:19:03.335816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a76cf1-18fe-4846-8cb3-bcfe84075a85 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:03.336332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a76cf1-18fe-4846-8cb3-bcfe84075a85 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:03.336449 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a76cf1-18fe-4846-8cb3-bcfe84075a85 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:03.337766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 561/1111] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:03.342991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5200e-c0c5-4df0-9358-4fc2ba053252 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:03.343374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5200e-c0c5-4df0-9358-4fc2ba053252 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:03.343590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5200e-c0c5-4df0-9358-4fc2ba053252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:03.360478 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a5b5200e-c0c5-4df0-9358-4fc2ba053252 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:03.361693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a5b5200e-c0c5-4df0-9358-4fc2ba053252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:03.423640 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 551/1112] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:19:03.447059 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a76cf1-18fe-4846-8cb3-bcfe84075a85 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:03.540948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a76cf1-18fe-4846-8cb3-bcfe84075a85 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:03.572313 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2047-4bf4-4e48-8157-a3b93f7de2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:03.573140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2047-4bf4-4e48-8157-a3b93f7de2ac None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:03.573451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2047-4bf4-4e48-8157-a3b93f7de2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:03.573729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2047-4bf4-4e48-8157-a3b93f7de2ac None admin] PATH_INFO: `/v3/roles/2f9013fc95d448a5b605f539fb6ae08f` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:03.575166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb2047-4bf4-4e48-8157-a3b93f7de2ac None admin] RBAC: Authorizing `identity:get_role(role_id=2f9013fc95d448a5b605f539fb6ae08f)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:03.576517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb2047-4bf4-4e48-8157-a3b93f7de2ac None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:03.577878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 562/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:03 2022] GET /identity/v3/roles/2f9013fc95d448a5b605f539fb6ae08f => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:03.584293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5200e-c0c5-4df0-9358-4fc2ba053252 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:03.678518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5200e-c0c5-4df0-9358-4fc2ba053252 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:03.713957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f601d1-b80a-4c6e-8a56-03d9043d5959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:03.714855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f601d1-b80a-4c6e-8a56-03d9043d5959 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:03.715141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f601d1-b80a-4c6e-8a56-03d9043d5959 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:03.715418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f601d1-b80a-4c6e-8a56-03d9043d5959 None admin] PATH_INFO: `/v3/users/8d4fea8c0dc24c6890cbbda2b97150de` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:03.729925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f601d1-b80a-4c6e-8a56-03d9043d5959 None admin] RBAC: Authorizing `identity:get_user(user_id=8d4fea8c0dc24c6890cbbda2b97150de)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:03.731413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f601d1-b80a-4c6e-8a56-03d9043d5959 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:03.733184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 552/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:03 2022] GET /identity/v3/users/8d4fea8c0dc24c6890cbbda2b97150de => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:03.739752 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2047-4bf4-4e48-8157-a3b93f7de2ac None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:03.837379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2047-4bf4-4e48-8157-a3b93f7de2ac None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:03.869979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408ba39-b259-48fd-9afa-d20389fe9b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:03.870634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408ba39-b259-48fd-9afa-d20389fe9b31 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:03.870923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408ba39-b259-48fd-9afa-d20389fe9b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:03.871209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408ba39-b259-48fd-9afa-d20389fe9b31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:03.944701 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408ba39-b259-48fd-9afa-d20389fe9b31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:03.946118 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408ba39-b259-48fd-9afa-d20389fe9b31 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:04.041471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 563/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:19:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:19:04.047427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f601d1-b80a-4c6e-8a56-03d9043d5959 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:04.143026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f601d1-b80a-4c6e-8a56-03d9043d5959 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:04.175365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3a279-6169-4f6c-9a4a-df21146acbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:04.176215 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3a279-6169-4f6c-9a4a-df21146acbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:04.176499 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3a279-6169-4f6c-9a4a-df21146acbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:04.176775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3a279-6169-4f6c-9a4a-df21146acbb4 None admin] PATH_INFO: `/v3/projects/11f19c61611a40218309308cf40e111d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:04.177957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3a279-6169-4f6c-9a4a-df21146acbb4 None admin] RBAC: Authorizing `identity:get_project(project_id=11f19c61611a40218309308cf40e111d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:04.179361 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3a279-6169-4f6c-9a4a-df21146acbb4 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:04.181033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 553/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:19:04 2022] GET /identity/v3/projects/11f19c61611a40218309308cf40e111d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:04.187135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408ba39-b259-48fd-9afa-d20389fe9b31 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:04.280075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408ba39-b259-48fd-9afa-d20389fe9b31 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:04.311011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544329e0-7c60-42f2-988b-52c7ba09c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:04.311646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544329e0-7c60-42f2-988b-52c7ba09c2dc None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:04.311928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544329e0-7c60-42f2-988b-52c7ba09c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:04.312204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544329e0-7c60-42f2-988b-52c7ba09c2dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:04.313016 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544329e0-7c60-42f2-988b-52c7ba09c2dc None admin] RBAC: Adding query filter params (role.id=2f9013fc95d448a5b605f539fb6ae08f, scope.project.id=11f19c61611a40218309308cf40e111d, user.id=8d4fea8c0dc24c6890cbbda2b97150de) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:04.313347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544329e0-7c60-42f2-988b-52c7ba09c2dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:04.314749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544329e0-7c60-42f2-988b-52c7ba09c2dc None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:04.320435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 564/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:19:04 2022] GET /identity/v3/role_assignments?user.id=8d4fea8c0dc24c6890cbbda2b97150de&scope.project.id=11f19c61611a40218309308cf40e111d&role.id=2f9013fc95d448a5b605f539fb6ae08f => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:06.564326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc957608-838a-4a42-9927-f880ece953be None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:06.564879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc957608-838a-4a42-9927-f880ece953be None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:06.565115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc957608-838a-4a42-9927-f880ece953be None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:06.567292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 554/1118] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:06.573822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f81dd-53c4-4a88-a261-f38512685a6a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:06.574248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f81dd-53c4-4a88-a261-f38512685a6a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:06.574402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f81dd-53c4-4a88-a261-f38512685a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:06.591278 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-179f81dd-53c4-4a88-a261-f38512685a6a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:06.592472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-179f81dd-53c4-4a88-a261-f38512685a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:06.658414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 565/1119] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:06.682194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc957608-838a-4a42-9927-f880ece953be None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:06.783556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc957608-838a-4a42-9927-f880ece953be None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:06.816752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22664e7-07d0-4eda-9b3d-d8563deb5e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:06.817555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22664e7-07d0-4eda-9b3d-d8563deb5e75 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:06.817838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22664e7-07d0-4eda-9b3d-d8563deb5e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:06.818113 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22664e7-07d0-4eda-9b3d-d8563deb5e75 None admin] PATH_INFO: `/v3/roles/2f9013fc95d448a5b605f539fb6ae08f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:06.819575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22664e7-07d0-4eda-9b3d-d8563deb5e75 None admin] RBAC: Authorizing `identity:get_role(role_id=2f9013fc95d448a5b605f539fb6ae08f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:06.820938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22664e7-07d0-4eda-9b3d-d8563deb5e75 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:06.822339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 555/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:06 2022] GET /identity/v3/roles/2f9013fc95d448a5b605f539fb6ae08f => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:06.828341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f81dd-53c4-4a88-a261-f38512685a6a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:06.924106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f81dd-53c4-4a88-a261-f38512685a6a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:06.957146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659693a-5a12-4160-85b2-5efa7698286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:06.958041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659693a-5a12-4160-85b2-5efa7698286e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:06.958330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659693a-5a12-4160-85b2-5efa7698286e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:06.958611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659693a-5a12-4160-85b2-5efa7698286e None admin] PATH_INFO: `/v3/users/8d4fea8c0dc24c6890cbbda2b97150de` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:06.959796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659693a-5a12-4160-85b2-5efa7698286e None admin] RBAC: Authorizing `identity:get_user(user_id=8d4fea8c0dc24c6890cbbda2b97150de)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:06.961221 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659693a-5a12-4160-85b2-5efa7698286e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:06.962873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 566/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:06 2022] GET /identity/v3/users/8d4fea8c0dc24c6890cbbda2b97150de => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:06.968478 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22664e7-07d0-4eda-9b3d-d8563deb5e75 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:07.065882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22664e7-07d0-4eda-9b3d-d8563deb5e75 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:07.098284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfdba7-fd9b-43d8-a3a5-5ac82d94b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:07.099131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfdba7-fd9b-43d8-a3a5-5ac82d94b4ad None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:07.099419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfdba7-fd9b-43d8-a3a5-5ac82d94b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:07.099701 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfdba7-fd9b-43d8-a3a5-5ac82d94b4ad None admin] PATH_INFO: `/v3/projects/11f19c61611a40218309308cf40e111d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:07.100871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfdba7-fd9b-43d8-a3a5-5ac82d94b4ad None admin] RBAC: Authorizing `identity:get_project(project_id=11f19c61611a40218309308cf40e111d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:07.102329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfdba7-fd9b-43d8-a3a5-5ac82d94b4ad None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:07.103984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 556/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:19:06 2022] GET /identity/v3/projects/11f19c61611a40218309308cf40e111d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:07.109968 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659693a-5a12-4160-85b2-5efa7698286e None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:07.204617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659693a-5a12-4160-85b2-5efa7698286e None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:07.239824 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9199-c675-435a-9439-b24920f998eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:07.240693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9199-c675-435a-9439-b24920f998eb None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:07.240972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9199-c675-435a-9439-b24920f998eb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:07.241246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9199-c675-435a-9439-b24920f998eb None admin] PATH_INFO: `/v3/projects/11f19c61611a40218309308cf40e111d/users/8d4fea8c0dc24c6890cbbda2b97150de/roles/2f9013fc95d448a5b605f539fb6ae08f` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:07.243453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b9199-c675-435a-9439-b24920f998eb None admin] RBAC: Authorizing `identity:create_grant(project_id=11f19c61611a40218309308cf40e111d, user_id=8d4fea8c0dc24c6890cbbda2b97150de, role_id=2f9013fc95d448a5b605f539fb6ae08f)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:07.245135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b9199-c675-435a-9439-b24920f998eb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:07.358234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 567/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:19:07 2022] PUT /identity/v3/projects/11f19c61611a40218309308cf40e111d/users/8d4fea8c0dc24c6890cbbda2b97150de/roles/2f9013fc95d448a5b605f539fb6ae08f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:19:09.548431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cad9f-2602-46d1-8ed4-c4601e487e6c None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:09.548991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cad9f-2602-46d1-8ed4-c4601e487e6c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:09.548991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cad9f-2602-46d1-8ed4-c4601e487e6c None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:09.550736 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 557/1124] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:19:09.556084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba19e-cd59-403e-8175-9a645d973bde None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:09.556488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba19e-cd59-403e-8175-9a645d973bde None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:09.556645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eba19e-cd59-403e-8175-9a645d973bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:09.573381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-59eba19e-cd59-403e-8175-9a645d973bde None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:09.574590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-59eba19e-cd59-403e-8175-9a645d973bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:09.637555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 568/1125] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:09.662006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cad9f-2602-46d1-8ed4-c4601e487e6c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:09.760144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cad9f-2602-46d1-8ed4-c4601e487e6c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:09.791941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d659d3-46b3-4665-85c7-8da25facfb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:09.792783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d659d3-46b3-4665-85c7-8da25facfb53 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:09.793067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d659d3-46b3-4665-85c7-8da25facfb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:09.793375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d659d3-46b3-4665-85c7-8da25facfb53 None admin] PATH_INFO: `/v3/roles/2f9013fc95d448a5b605f539fb6ae08f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:09.794848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d659d3-46b3-4665-85c7-8da25facfb53 None admin] RBAC: Authorizing `identity:get_role(role_id=2f9013fc95d448a5b605f539fb6ae08f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:09.796216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d659d3-46b3-4665-85c7-8da25facfb53 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:09.797591 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 558/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:09 2022] GET /identity/v3/roles/2f9013fc95d448a5b605f539fb6ae08f => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:09.804060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba19e-cd59-403e-8175-9a645d973bde None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:09.899734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eba19e-cd59-403e-8175-9a645d973bde None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:09.932751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202c03-5144-4c17-8091-b0298594ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:09.933652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202c03-5144-4c17-8091-b0298594ad38 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:09.933941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202c03-5144-4c17-8091-b0298594ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:09.934220 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202c03-5144-4c17-8091-b0298594ad38 None admin] PATH_INFO: `/v3/users/8d4fea8c0dc24c6890cbbda2b97150de` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:09.935387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40202c03-5144-4c17-8091-b0298594ad38 None admin] RBAC: Authorizing `identity:get_user(user_id=8d4fea8c0dc24c6890cbbda2b97150de)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:09.936824 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40202c03-5144-4c17-8091-b0298594ad38 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:09.938477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 569/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:09 2022] GET /identity/v3/users/8d4fea8c0dc24c6890cbbda2b97150de => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:09.944750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d659d3-46b3-4665-85c7-8da25facfb53 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:10.037631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d659d3-46b3-4665-85c7-8da25facfb53 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:10.069584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ece65b-e21b-4f51-88cd-3fa55be0427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:10.070158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece65b-e21b-4f51-88cd-3fa55be0427e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:10.070445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece65b-e21b-4f51-88cd-3fa55be0427e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:10.070723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ece65b-e21b-4f51-88cd-3fa55be0427e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:10.133779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ece65b-e21b-4f51-88cd-3fa55be0427e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:10.135216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ece65b-e21b-4f51-88cd-3fa55be0427e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:10.226866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 559/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:19:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:19:10.232705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202c03-5144-4c17-8091-b0298594ad38 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:10.325438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202c03-5144-4c17-8091-b0298594ad38 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:10.356928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c2a56-2825-4d8a-8bf9-5c838c5a2ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:10.357804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c2a56-2825-4d8a-8bf9-5c838c5a2ebd None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:10.358090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c2a56-2825-4d8a-8bf9-5c838c5a2ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:10.358369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c2a56-2825-4d8a-8bf9-5c838c5a2ebd None admin] PATH_INFO: `/v3/projects/11f19c61611a40218309308cf40e111d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:10.359523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c2a56-2825-4d8a-8bf9-5c838c5a2ebd None admin] RBAC: Authorizing `identity:get_project(project_id=11f19c61611a40218309308cf40e111d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:10.360931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c2a56-2825-4d8a-8bf9-5c838c5a2ebd None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:10.363350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 570/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:19:10 2022] GET /identity/v3/projects/11f19c61611a40218309308cf40e111d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:10.369638 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ece65b-e21b-4f51-88cd-3fa55be0427e None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:10.462766 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ece65b-e21b-4f51-88cd-3fa55be0427e None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:10.495001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c8c0c-5a45-43d2-a430-979e94ad30bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:10.495646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c8c0c-5a45-43d2-a430-979e94ad30bb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:10.495928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c8c0c-5a45-43d2-a430-979e94ad30bb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:10.496204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c8c0c-5a45-43d2-a430-979e94ad30bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:10.497024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c8c0c-5a45-43d2-a430-979e94ad30bb None admin] RBAC: Adding query filter params (role.id=2f9013fc95d448a5b605f539fb6ae08f, scope.project.id=11f19c61611a40218309308cf40e111d, user.id=8d4fea8c0dc24c6890cbbda2b97150de) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:10.497363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c8c0c-5a45-43d2-a430-979e94ad30bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:10.498778 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c8c0c-5a45-43d2-a430-979e94ad30bb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:10.504549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 560/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:19:10 2022] GET /identity/v3/role_assignments?user.id=8d4fea8c0dc24c6890cbbda2b97150de&scope.project.id=11f19c61611a40218309308cf40e111d&role.id=2f9013fc95d448a5b605f539fb6ae08f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:12.743243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa6927-b981-4a34-9885-fdb4c21c1848 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:12.743813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa6927-b981-4a34-9885-fdb4c21c1848 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:12.743813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa6927-b981-4a34-9885-fdb4c21c1848 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:12.745426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 571/1131] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:12.750607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c9f97-f627-42c1-98a9-e1ed591210cd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:12.751017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c9f97-f627-42c1-98a9-e1ed591210cd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:12.751165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c9f97-f627-42c1-98a9-e1ed591210cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:12.769726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3f5c9f97-f627-42c1-98a9-e1ed591210cd None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:12.770904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3f5c9f97-f627-42c1-98a9-e1ed591210cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:12.833473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 561/1132] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:12.856048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa6927-b981-4a34-9885-fdb4c21c1848 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:12.953858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa6927-b981-4a34-9885-fdb4c21c1848 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:12.985473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff23cc9-f713-49f3-9af3-3449102444ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:12.986267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23cc9-f713-49f3-9af3-3449102444ef None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:12.986555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23cc9-f713-49f3-9af3-3449102444ef None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:12.986835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23cc9-f713-49f3-9af3-3449102444ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:12.988542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff23cc9-f713-49f3-9af3-3449102444ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:12.989997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff23cc9-f713-49f3-9af3-3449102444ef None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:12.991598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 572/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:19:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:12.997724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c9f97-f627-42c1-98a9-e1ed591210cd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:13.092297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c9f97-f627-42c1-98a9-e1ed591210cd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:13.125369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760f6c5-64e3-4fab-8e29-cdf13b536120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:13.126021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760f6c5-64e3-4fab-8e29-cdf13b536120 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:13.126306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760f6c5-64e3-4fab-8e29-cdf13b536120 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:13.126580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760f6c5-64e3-4fab-8e29-cdf13b536120 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:13.127274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760f6c5-64e3-4fab-8e29-cdf13b536120 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:13.129177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760f6c5-64e3-4fab-8e29-cdf13b536120 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:13.210186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 562/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:19:12 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:19:15.438145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb699-e9b5-4dea-b89b-ca11ff6809db None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:15.438694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb699-e9b5-4dea-b89b-ca11ff6809db None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:15.438694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb699-e9b5-4dea-b89b-ca11ff6809db None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:15.440553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 573/1135] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:15.445949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf808d-6f64-4235-98a7-b0e73cb64db0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:15.446375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf808d-6f64-4235-98a7-b0e73cb64db0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:15.446513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf808d-6f64-4235-98a7-b0e73cb64db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:15.464250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f0bf808d-6f64-4235-98a7-b0e73cb64db0 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:15.465459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f0bf808d-6f64-4235-98a7-b0e73cb64db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:15.529027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 563/1136] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:15.553839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdb699-e9b5-4dea-b89b-ca11ff6809db None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:15.649281 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdb699-e9b5-4dea-b89b-ca11ff6809db None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:15.680671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae58bc-5981-4b67-bba1-a8f8b1872b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:15.681472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae58bc-5981-4b67-bba1-a8f8b1872b4e None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:15.681758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae58bc-5981-4b67-bba1-a8f8b1872b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:15.682036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae58bc-5981-4b67-bba1-a8f8b1872b4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:15.683200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae58bc-5981-4b67-bba1-a8f8b1872b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:15.684622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae58bc-5981-4b67-bba1-a8f8b1872b4e None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:15.686228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 574/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:19:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:15.692646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf808d-6f64-4235-98a7-b0e73cb64db0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:15.801535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf808d-6f64-4235-98a7-b0e73cb64db0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:15.834392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ef2aa-f92f-4bf9-a408-1fbf8cddf8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:15.835055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ef2aa-f92f-4bf9-a408-1fbf8cddf8f8 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:15.835422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ef2aa-f92f-4bf9-a408-1fbf8cddf8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:15.835702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ef2aa-f92f-4bf9-a408-1fbf8cddf8f8 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:15.836414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ef2aa-f92f-4bf9-a408-1fbf8cddf8f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:15.837864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ef2aa-f92f-4bf9-a408-1fbf8cddf8f8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:15.933689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 564/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:19:15 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:19:18.186409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab761ba-f3e2-46e8-961f-23dffa43aa3e None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:18.186987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab761ba-f3e2-46e8-961f-23dffa43aa3e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:18.186987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab761ba-f3e2-46e8-961f-23dffa43aa3e None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:18.188240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 575/1139] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:18.194177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f1386-2437-4804-8096-bc96fe84749a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:18.194612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f1386-2437-4804-8096-bc96fe84749a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:18.194748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f1386-2437-4804-8096-bc96fe84749a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:18.210762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-806f1386-2437-4804-8096-bc96fe84749a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:18.211937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-806f1386-2437-4804-8096-bc96fe84749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:18.281931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 565/1140] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:18.305779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab761ba-f3e2-46e8-961f-23dffa43aa3e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:18.401395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab761ba-f3e2-46e8-961f-23dffa43aa3e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:18.433684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee57ef-3cf4-4b2d-b1a3-07df6de8e190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:18.434461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee57ef-3cf4-4b2d-b1a3-07df6de8e190 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:18.434747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee57ef-3cf4-4b2d-b1a3-07df6de8e190 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:18.435024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee57ef-3cf4-4b2d-b1a3-07df6de8e190 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:18.444706 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee57ef-3cf4-4b2d-b1a3-07df6de8e190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-8eee57ef-3cf4-4b2d-b1a3-07df6de8e190 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:19:18.452119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:19:18.453325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:19:18.454438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 576/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:19:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:19:18.459558 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f1386-2437-4804-8096-bc96fe84749a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:18.552912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f1386-2437-4804-8096-bc96fe84749a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:18.584007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17b24-8358-4222-b66c-4cc9116402da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:18.584666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17b24-8358-4222-b66c-4cc9116402da None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:18.584955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17b24-8358-4222-b66c-4cc9116402da None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:18.585238 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17b24-8358-4222-b66c-4cc9116402da None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:18.586016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f17b24-8358-4222-b66c-4cc9116402da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:18.586326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f17b24-8358-4222-b66c-4cc9116402da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:18.587678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f17b24-8358-4222-b66c-4cc9116402da None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:18.595297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 566/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:19:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:18.601797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee57ef-3cf4-4b2d-b1a3-07df6de8e190 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:18.694301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee57ef-3cf4-4b2d-b1a3-07df6de8e190 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:18.726137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55136e-cb5e-4900-9427-6598788f1bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:18.726918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55136e-cb5e-4900-9427-6598788f1bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:18.727194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55136e-cb5e-4900-9427-6598788f1bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:18.727464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55136e-cb5e-4900-9427-6598788f1bf8 None admin] PATH_INFO: `/v3/users/c94edadb379843efb195c89d57e93037` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:18.739962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55136e-cb5e-4900-9427-6598788f1bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=c94edadb379843efb195c89d57e93037)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:18.741470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55136e-cb5e-4900-9427-6598788f1bf8 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:18.743079 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 577/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:18 2022] GET /identity/v3/users/c94edadb379843efb195c89d57e93037 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:18.749114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17b24-8358-4222-b66c-4cc9116402da None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:18.842990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17b24-8358-4222-b66c-4cc9116402da None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:18.874766 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebc506-a288-40f3-9b97-1af83a6da66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:18.875415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebc506-a288-40f3-9b97-1af83a6da66c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:18.875699 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebc506-a288-40f3-9b97-1af83a6da66c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:18.875973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebc506-a288-40f3-9b97-1af83a6da66c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:18.938509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebc506-a288-40f3-9b97-1af83a6da66c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:18.939977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebc506-a288-40f3-9b97-1af83a6da66c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:19.031702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 567/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:19:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:19:19.037905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55136e-cb5e-4900-9427-6598788f1bf8 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:19.132438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55136e-cb5e-4900-9427-6598788f1bf8 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:19.164582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d2a0c-4314-4963-86b7-a516a3dd302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:19.165463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d2a0c-4314-4963-86b7-a516a3dd302d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:19.165746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d2a0c-4314-4963-86b7-a516a3dd302d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:19.166018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d2a0c-4314-4963-86b7-a516a3dd302d None admin] PATH_INFO: `/v3/projects/3b02e146edce4f82bb67c60a943b7812` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:19.167179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d2a0c-4314-4963-86b7-a516a3dd302d None admin] RBAC: Authorizing `identity:get_project(project_id=3b02e146edce4f82bb67c60a943b7812)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:19.168608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d2a0c-4314-4963-86b7-a516a3dd302d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:19.170315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 578/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:19:19 2022] GET /identity/v3/projects/3b02e146edce4f82bb67c60a943b7812 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:19.176393 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebc506-a288-40f3-9b97-1af83a6da66c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:19.271198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebc506-a288-40f3-9b97-1af83a6da66c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:19.303715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3c163-6e01-4854-a11f-e5ace205a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:19.304302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3c163-6e01-4854-a11f-e5ace205a91b None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:19.304581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3c163-6e01-4854-a11f-e5ace205a91b None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:19.304855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3c163-6e01-4854-a11f-e5ace205a91b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:19.305692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3c163-6e01-4854-a11f-e5ace205a91b None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=3b02e146edce4f82bb67c60a943b7812, user.id=c94edadb379843efb195c89d57e93037) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:19.305999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3c163-6e01-4854-a11f-e5ace205a91b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:19.307404 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3c163-6e01-4854-a11f-e5ace205a91b None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:19.312648 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 568/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:19:19 2022] GET /identity/v3/role_assignments?user.id=c94edadb379843efb195c89d57e93037&scope.project.id=3b02e146edce4f82bb67c60a943b7812&role.id=4ae0665802b946be870ab06274297a1d => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:21.481768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031979-14ae-49cf-8918-eed54f8aacaf None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:21.481768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031979-14ae-49cf-8918-eed54f8aacaf None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:21.481768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8031979-14ae-49cf-8918-eed54f8aacaf None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:21.481768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 579/1147] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:21.487929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67912792-991b-4d30-9a21-9f8b6fadce7a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:21.488333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67912792-991b-4d30-9a21-9f8b6fadce7a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:21.488493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67912792-991b-4d30-9a21-9f8b6fadce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:21.505208 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-67912792-991b-4d30-9a21-9f8b6fadce7a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:21.506541 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-67912792-991b-4d30-9a21-9f8b6fadce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:21.571656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 569/1148] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:21.594502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031979-14ae-49cf-8918-eed54f8aacaf None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:21.694558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8031979-14ae-49cf-8918-eed54f8aacaf None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:21.727617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26be29-1b96-4be7-9cb4-37106265440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:21.728401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26be29-1b96-4be7-9cb4-37106265440a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:21.728686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26be29-1b96-4be7-9cb4-37106265440a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:21.728964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26be29-1b96-4be7-9cb4-37106265440a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:21.738902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26be29-1b96-4be7-9cb4-37106265440a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-3a26be29-1b96-4be7-9cb4-37106265440a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:19:21.746664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:19:21.747790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:19:21.749019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 580/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:19:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:19:21.754175 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67912792-991b-4d30-9a21-9f8b6fadce7a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:21.848340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67912792-991b-4d30-9a21-9f8b6fadce7a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:21.880199 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ad91-ac78-4e4a-8c36-90afce01c05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:21.880867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ad91-ac78-4e4a-8c36-90afce01c05c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:21.881155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ad91-ac78-4e4a-8c36-90afce01c05c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:21.881465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ad91-ac78-4e4a-8c36-90afce01c05c None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:21.882216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ad91-ac78-4e4a-8c36-90afce01c05c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:21.882525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ad91-ac78-4e4a-8c36-90afce01c05c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:21.883876 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ad91-ac78-4e4a-8c36-90afce01c05c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:21.891530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 570/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:21.897915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26be29-1b96-4be7-9cb4-37106265440a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:21.991598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26be29-1b96-4be7-9cb4-37106265440a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:22.023978 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebac25-cd67-4e9e-974a-50cec3ec5935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:22.024847 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebac25-cd67-4e9e-974a-50cec3ec5935 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:22.025138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebac25-cd67-4e9e-974a-50cec3ec5935 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:22.025459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebac25-cd67-4e9e-974a-50cec3ec5935 None admin] PATH_INFO: `/v3/users/c94edadb379843efb195c89d57e93037` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:22.026644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebac25-cd67-4e9e-974a-50cec3ec5935 None admin] RBAC: Authorizing `identity:get_user(user_id=c94edadb379843efb195c89d57e93037)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:22.028075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebac25-cd67-4e9e-974a-50cec3ec5935 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:22.029728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 581/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:21 2022] GET /identity/v3/users/c94edadb379843efb195c89d57e93037 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:22.036519 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ad91-ac78-4e4a-8c36-90afce01c05c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:22.130529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ad91-ac78-4e4a-8c36-90afce01c05c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:22.162009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d7c81-5471-4e6c-984a-59bc68724b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:22.162852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d7c81-5471-4e6c-984a-59bc68724b03 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:22.163137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d7c81-5471-4e6c-984a-59bc68724b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:22.163428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d7c81-5471-4e6c-984a-59bc68724b03 None admin] PATH_INFO: `/v3/projects/3b02e146edce4f82bb67c60a943b7812` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:22.164589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d7c81-5471-4e6c-984a-59bc68724b03 None admin] RBAC: Authorizing `identity:get_project(project_id=3b02e146edce4f82bb67c60a943b7812)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:22.166019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d7c81-5471-4e6c-984a-59bc68724b03 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:22.167658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 571/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:19:22 2022] GET /identity/v3/projects/3b02e146edce4f82bb67c60a943b7812 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:22.173435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebac25-cd67-4e9e-974a-50cec3ec5935 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:22.267730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebac25-cd67-4e9e-974a-50cec3ec5935 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:22.299980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7c87c-cd40-4dbc-9b4a-0613e0b0c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:22.300854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7c87c-cd40-4dbc-9b4a-0613e0b0c3b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:22.301135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7c87c-cd40-4dbc-9b4a-0613e0b0c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:22.301459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7c87c-cd40-4dbc-9b4a-0613e0b0c3b6 None admin] PATH_INFO: `/v3/projects/3b02e146edce4f82bb67c60a943b7812/users/c94edadb379843efb195c89d57e93037/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:22.303382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7c87c-cd40-4dbc-9b4a-0613e0b0c3b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b02e146edce4f82bb67c60a943b7812, user_id=c94edadb379843efb195c89d57e93037, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:22.304799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7c87c-cd40-4dbc-9b4a-0613e0b0c3b6 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:22.386286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 582/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:19:22 2022] PUT /identity/v3/projects/3b02e146edce4f82bb67c60a943b7812/users/c94edadb379843efb195c89d57e93037/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:19:24.578028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e557020-f0bd-4851-b706-e0b51bda90d0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:24.578594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e557020-f0bd-4851-b706-e0b51bda90d0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:24.578594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e557020-f0bd-4851-b706-e0b51bda90d0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:24.579928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 572/1154] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:24.585293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3a33-716a-4460-b1ee-e2c38c52806b None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:24.585698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3a33-716a-4460-b1ee-e2c38c52806b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:24.585866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3a33-716a-4460-b1ee-e2c38c52806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:24.602711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-b06c3a33-716a-4460-b1ee-e2c38c52806b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:24.603919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b06c3a33-716a-4460-b1ee-e2c38c52806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:24.671265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 583/1155] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:24.695974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e557020-f0bd-4851-b706-e0b51bda90d0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:24.796974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e557020-f0bd-4851-b706-e0b51bda90d0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:24.829146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdd15-1bf9-42b0-95d7-7e9dd8cba240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:24.829877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdd15-1bf9-42b0-95d7-7e9dd8cba240 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:24.830160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdd15-1bf9-42b0-95d7-7e9dd8cba240 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:24.830977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdd15-1bf9-42b0-95d7-7e9dd8cba240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:24.841762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abdd15-1bf9-42b0-95d7-7e9dd8cba240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-f3abdd15-1bf9-42b0-95d7-7e9dd8cba240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:19:24.849905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:19:24.851050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:19:24.852101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 573/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:19:24.857528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c3a33-716a-4460-b1ee-e2c38c52806b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:24.953053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c3a33-716a-4460-b1ee-e2c38c52806b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:24.985657 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3b2f6-3c5c-405d-8586-44f30aa4794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:24.986314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3b2f6-3c5c-405d-8586-44f30aa4794b None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:24.986597 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3b2f6-3c5c-405d-8586-44f30aa4794b None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:24.986948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3b2f6-3c5c-405d-8586-44f30aa4794b None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:24.987856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3b2f6-3c5c-405d-8586-44f30aa4794b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:24.988162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3b2f6-3c5c-405d-8586-44f30aa4794b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:24.989546 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3b2f6-3c5c-405d-8586-44f30aa4794b None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:24.997543 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 584/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:25.003552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdd15-1bf9-42b0-95d7-7e9dd8cba240 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:25.098791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdd15-1bf9-42b0-95d7-7e9dd8cba240 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:25.130987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db791d7e-fcf1-49f9-a496-d2266c3a784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:25.131847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db791d7e-fcf1-49f9-a496-d2266c3a784c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:25.132134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db791d7e-fcf1-49f9-a496-d2266c3a784c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:25.132411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db791d7e-fcf1-49f9-a496-d2266c3a784c None admin] PATH_INFO: `/v3/users/c94edadb379843efb195c89d57e93037` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:25.133610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db791d7e-fcf1-49f9-a496-d2266c3a784c None admin] RBAC: Authorizing `identity:get_user(user_id=c94edadb379843efb195c89d57e93037)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:25.135040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db791d7e-fcf1-49f9-a496-d2266c3a784c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:25.136750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 574/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:25 2022] GET /identity/v3/users/c94edadb379843efb195c89d57e93037 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:25.142437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3b2f6-3c5c-405d-8586-44f30aa4794b None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:25.237970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3b2f6-3c5c-405d-8586-44f30aa4794b None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:25.270225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed294-3e2d-406a-8d87-2b8b991d396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:25.270869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed294-3e2d-406a-8d87-2b8b991d396d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:25.271155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed294-3e2d-406a-8d87-2b8b991d396d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:25.271435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed294-3e2d-406a-8d87-2b8b991d396d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:25.334347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ed294-3e2d-406a-8d87-2b8b991d396d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:25.335805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ed294-3e2d-406a-8d87-2b8b991d396d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:25.430485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 585/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:19:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:19:25.436346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db791d7e-fcf1-49f9-a496-d2266c3a784c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:25.531811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db791d7e-fcf1-49f9-a496-d2266c3a784c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:25.566709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49680171-5f07-41bd-ad6d-2a2f88af7bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:25.567558 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49680171-5f07-41bd-ad6d-2a2f88af7bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:25.567840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49680171-5f07-41bd-ad6d-2a2f88af7bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:25.568117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49680171-5f07-41bd-ad6d-2a2f88af7bc2 None admin] PATH_INFO: `/v3/projects/3b02e146edce4f82bb67c60a943b7812` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:25.569302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49680171-5f07-41bd-ad6d-2a2f88af7bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=3b02e146edce4f82bb67c60a943b7812)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:25.570728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49680171-5f07-41bd-ad6d-2a2f88af7bc2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:25.572375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 575/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:19:25 2022] GET /identity/v3/projects/3b02e146edce4f82bb67c60a943b7812 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:25.578461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed294-3e2d-406a-8d87-2b8b991d396d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:25.670776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed294-3e2d-406a-8d87-2b8b991d396d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:25.703512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3388d7-221b-4039-bf54-ed0f85f7625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:25.704105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3388d7-221b-4039-bf54-ed0f85f7625a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:25.704389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3388d7-221b-4039-bf54-ed0f85f7625a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:25.704668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3388d7-221b-4039-bf54-ed0f85f7625a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:25.705656 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3388d7-221b-4039-bf54-ed0f85f7625a None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=3b02e146edce4f82bb67c60a943b7812, user.id=c94edadb379843efb195c89d57e93037) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:25.705980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3388d7-221b-4039-bf54-ed0f85f7625a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:25.707415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3388d7-221b-4039-bf54-ed0f85f7625a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:25.713136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 586/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:19:25 2022] GET /identity/v3/role_assignments?user.id=c94edadb379843efb195c89d57e93037&scope.project.id=3b02e146edce4f82bb67c60a943b7812&role.id=4ae0665802b946be870ab06274297a1d => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:28.082696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9325469-ec69-464e-86a0-71ffe8f576f6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:28.083221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9325469-ec69-464e-86a0-71ffe8f576f6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:28.083221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9325469-ec69-464e-86a0-71ffe8f576f6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:28.084582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 576/1162] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:28.089880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183aed-409c-48e5-8b67-85738ef116e3 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:28.090266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183aed-409c-48e5-8b67-85738ef116e3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:28.090445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183aed-409c-48e5-8b67-85738ef116e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:28.106567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-4d183aed-409c-48e5-8b67-85738ef116e3 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:28.107734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4d183aed-409c-48e5-8b67-85738ef116e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:28.170565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 587/1163] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:28.192602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9325469-ec69-464e-86a0-71ffe8f576f6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:28.293868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9325469-ec69-464e-86a0-71ffe8f576f6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:28.326419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d1a6b-b19a-42e7-bf0f-3034b4758409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:28.327062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1a6b-b19a-42e7-bf0f-3034b4758409 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:28.327347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1a6b-b19a-42e7-bf0f-3034b4758409 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:28.327624 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1a6b-b19a-42e7-bf0f-3034b4758409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:28.391661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d1a6b-b19a-42e7-bf0f-3034b4758409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:28.394004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d1a6b-b19a-42e7-bf0f-3034b4758409 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:28.486320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 577/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:19:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:19:28.492914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183aed-409c-48e5-8b67-85738ef116e3 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:28.587593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183aed-409c-48e5-8b67-85738ef116e3 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:28.624226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d725d7-6f37-4a3e-aa9c-464fdc83ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:28.625027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d725d7-6f37-4a3e-aa9c-464fdc83ecd7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:28.625337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d725d7-6f37-4a3e-aa9c-464fdc83ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:28.625622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d725d7-6f37-4a3e-aa9c-464fdc83ecd7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:28.632755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d725d7-6f37-4a3e-aa9c-464fdc83ecd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:28.634214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d725d7-6f37-4a3e-aa9c-464fdc83ecd7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-c6d725d7-6f37-4a3e-aa9c-464fdc83ecd7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:19:28.647953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:19:28.648982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:19:28.650055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 588/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 12 20:19:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:19:28.655117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d1a6b-b19a-42e7-bf0f-3034b4758409 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:28.748625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d1a6b-b19a-42e7-bf0f-3034b4758409 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:28.781115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338c80f-b2d5-465d-8687-866c71a0acde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:28.781794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c80f-b2d5-465d-8687-866c71a0acde None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:28.782082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c80f-b2d5-465d-8687-866c71a0acde None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:28.782362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c80f-b2d5-465d-8687-866c71a0acde None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:28.783079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338c80f-b2d5-465d-8687-866c71a0acde None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:28.783385 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338c80f-b2d5-465d-8687-866c71a0acde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:28.784760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338c80f-b2d5-465d-8687-866c71a0acde None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:28.791615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 578/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Thu May 12 20:19:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:30.981291 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec002c-328d-454b-b83b-afff0ed2bcba None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:30.981868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec002c-328d-454b-b83b-afff0ed2bcba None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:30.981868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec002c-328d-454b-b83b-afff0ed2bcba None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:30.983226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 589/1167] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:30.988965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d023f-226e-40ac-81d4-0bdb1fa90a23 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:30.989431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d023f-226e-40ac-81d4-0bdb1fa90a23 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:30.989563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d023f-226e-40ac-81d4-0bdb1fa90a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:31.009528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ea1d023f-226e-40ac-81d4-0bdb1fa90a23 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:31.010729 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ea1d023f-226e-40ac-81d4-0bdb1fa90a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:31.077444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 579/1168] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:19:31.100035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec002c-328d-454b-b83b-afff0ed2bcba None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:31.205705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec002c-328d-454b-b83b-afff0ed2bcba None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:31.239154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab456d-e637-404e-8411-e5cb4c7e6a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:31.239814 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab456d-e637-404e-8411-e5cb4c7e6a19 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:31.240103 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab456d-e637-404e-8411-e5cb4c7e6a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:31.240386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab456d-e637-404e-8411-e5cb4c7e6a19 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:31.241131 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab456d-e637-404e-8411-e5cb4c7e6a19 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:31.242548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab456d-e637-404e-8411-e5cb4c7e6a19 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:31.350065 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 590/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Thu May 12 20:19:31 2022] POST /identity/v3/domains => generated 267 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:19:33.622039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995c6dc-bd53-4a00-9248-cf2f7406e9cb None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:33.622605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995c6dc-bd53-4a00-9248-cf2f7406e9cb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:33.622605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995c6dc-bd53-4a00-9248-cf2f7406e9cb None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:33.623930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 580/1170] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:33.629858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166bd1-2ee9-443e-9844-159c5ebf3a59 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:33.630286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166bd1-2ee9-443e-9844-159c5ebf3a59 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:33.630409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166bd1-2ee9-443e-9844-159c5ebf3a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:33.649184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-9c166bd1-2ee9-443e-9844-159c5ebf3a59 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:33.650414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9c166bd1-2ee9-443e-9844-159c5ebf3a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:33.714440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 591/1171] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:33.738366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995c6dc-bd53-4a00-9248-cf2f7406e9cb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:33.836870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995c6dc-bd53-4a00-9248-cf2f7406e9cb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:33.869894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b179fc-f50c-4519-b468-599327a77700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:33.872224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b179fc-f50c-4519-b468-599327a77700 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:33.872224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b179fc-f50c-4519-b468-599327a77700 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:33.872224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b179fc-f50c-4519-b468-599327a77700 None admin] PATH_INFO: `/v3/domains/88109547595f4a76b496a3fde34af29b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:33.882049 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b179fc-f50c-4519-b468-599327a77700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=88109547595f4a76b496a3fde34af29b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:33.883515 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b179fc-f50c-4519-b468-599327a77700 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:33.885187 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 581/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Thu May 12 20:19:33 2022] GET /identity/v3/domains/88109547595f4a76b496a3fde34af29b => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:33.890987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c166bd1-2ee9-443e-9844-159c5ebf3a59 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:33.990359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c166bd1-2ee9-443e-9844-159c5ebf3a59 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:34.025428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538684a-a9fa-4f61-814f-681c6600489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:34.026089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538684a-a9fa-4f61-814f-681c6600489c None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:34.026371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538684a-a9fa-4f61-814f-681c6600489c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:34.026645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538684a-a9fa-4f61-814f-681c6600489c None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:34.027347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538684a-a9fa-4f61-814f-681c6600489c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:34.028758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538684a-a9fa-4f61-814f-681c6600489c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:34.176510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 592/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:19:33 2022] POST /identity/v3/projects => generated 361 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:19:36.453104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ab6d-b8d7-49bc-adc0-fb83089d74da None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:36.453712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ab6d-b8d7-49bc-adc0-fb83089d74da None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:36.453712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7ab6d-b8d7-49bc-adc0-fb83089d74da None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:36.455052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 582/1174] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:36.460724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59aee-965c-4488-acb8-8c2fea68bc5f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:36.461158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59aee-965c-4488-acb8-8c2fea68bc5f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:36.461429 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59aee-965c-4488-acb8-8c2fea68bc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:36.480034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-93b59aee-965c-4488-acb8-8c2fea68bc5f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:36.481418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-93b59aee-965c-4488-acb8-8c2fea68bc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:36.547333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 593/1175] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:36.572568 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7ab6d-b8d7-49bc-adc0-fb83089d74da None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:36.677045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7ab6d-b8d7-49bc-adc0-fb83089d74da None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:36.711364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8c2bd-cd0f-4b83-853a-67068b2f9bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:36.712162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8c2bd-cd0f-4b83-853a-67068b2f9bdc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:36.712443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8c2bd-cd0f-4b83-853a-67068b2f9bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:36.712718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8c2bd-cd0f-4b83-853a-67068b2f9bdc None admin] PATH_INFO: `/v3/domains/88109547595f4a76b496a3fde34af29b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:36.713913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8c2bd-cd0f-4b83-853a-67068b2f9bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=88109547595f4a76b496a3fde34af29b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:36.715336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8c2bd-cd0f-4b83-853a-67068b2f9bdc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:36.716918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 583/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Thu May 12 20:19:36 2022] GET /identity/v3/domains/88109547595f4a76b496a3fde34af29b => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:36.723622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59aee-965c-4488-acb8-8c2fea68bc5f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:36.817644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59aee-965c-4488-acb8-8c2fea68bc5f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:36.849866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba497aa-8c60-43db-b9fb-048f3b0fba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:36.850882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba497aa-8c60-43db-b9fb-048f3b0fba5c None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:36.851178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba497aa-8c60-43db-b9fb-048f3b0fba5c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:36.851461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba497aa-8c60-43db-b9fb-048f3b0fba5c None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:36.852162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba497aa-8c60-43db-b9fb-048f3b0fba5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:36.853631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba497aa-8c60-43db-b9fb-048f3b0fba5c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:36.963604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 594/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:19:36 2022] POST /identity/v3/users => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:19:39.290002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d137c-2109-4132-8f33-1c05004d5f95 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:39.290514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d137c-2109-4132-8f33-1c05004d5f95 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:39.290514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d137c-2109-4132-8f33-1c05004d5f95 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:39.291803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 584/1178] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:39.297075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57217af0-9b26-4132-bec5-b1005ab73af0 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:39.297500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57217af0-9b26-4132-bec5-b1005ab73af0 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:39.297682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57217af0-9b26-4132-bec5-b1005ab73af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:39.314411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-57217af0-9b26-4132-bec5-b1005ab73af0 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:39.316234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-57217af0-9b26-4132-bec5-b1005ab73af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:39.380463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 595/1179] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:39.403645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d137c-2109-4132-8f33-1c05004d5f95 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:39.507758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d137c-2109-4132-8f33-1c05004d5f95 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:39.540939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ada1d-ecf5-4f9c-8ff1-08e4b9cacdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:39.541681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ada1d-ecf5-4f9c-8ff1-08e4b9cacdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:39.541963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ada1d-ecf5-4f9c-8ff1-08e4b9cacdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:39.542242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ada1d-ecf5-4f9c-8ff1-08e4b9cacdb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:39.553681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ada1d-ecf5-4f9c-8ff1-08e4b9cacdb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-062ada1d-ecf5-4f9c-8ff1-08e4b9cacdb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:19:39.561171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:19:39.562383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:19:39.563514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 585/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:19:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:19:39.568878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57217af0-9b26-4132-bec5-b1005ab73af0 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:39.667045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57217af0-9b26-4132-bec5-b1005ab73af0 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:39.700315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079e1a8-ac3b-45fb-bcb2-f628d1fd73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:39.700981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e1a8-ac3b-45fb-bcb2-f628d1fd73e9 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:39.701266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e1a8-ac3b-45fb-bcb2-f628d1fd73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:39.701574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e1a8-ac3b-45fb-bcb2-f628d1fd73e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:39.702322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079e1a8-ac3b-45fb-bcb2-f628d1fd73e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:39.702631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079e1a8-ac3b-45fb-bcb2-f628d1fd73e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:39.704000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079e1a8-ac3b-45fb-bcb2-f628d1fd73e9 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:39.712548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 596/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:19:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:39.718331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ada1d-ecf5-4f9c-8ff1-08e4b9cacdb7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:39.814028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ada1d-ecf5-4f9c-8ff1-08e4b9cacdb7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:39.845709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc779976-e1a4-4188-ad1d-2024f67b20bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:39.846727 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc779976-e1a4-4188-ad1d-2024f67b20bb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:39.847009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc779976-e1a4-4188-ad1d-2024f67b20bb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:39.847289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc779976-e1a4-4188-ad1d-2024f67b20bb None admin] PATH_INFO: `/v3/users/c27dbffe117841158e0b22d293758c51` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:39.860450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc779976-e1a4-4188-ad1d-2024f67b20bb None admin] RBAC: Authorizing `identity:get_user(user_id=c27dbffe117841158e0b22d293758c51)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:39.862668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc779976-e1a4-4188-ad1d-2024f67b20bb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:39.864219 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 586/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:39 2022] GET /identity/v3/users/c27dbffe117841158e0b22d293758c51 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:39.870121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079e1a8-ac3b-45fb-bcb2-f628d1fd73e9 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:39.964839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079e1a8-ac3b-45fb-bcb2-f628d1fd73e9 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:39.996486 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b693-ff3d-4a4d-ad1a-796e35f50ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:39.997130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b693-ff3d-4a4d-ad1a-796e35f50ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:39.997447 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b693-ff3d-4a4d-ad1a-796e35f50ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:39.997729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b693-ff3d-4a4d-ad1a-796e35f50ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:40.062191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7b693-ff3d-4a4d-ad1a-796e35f50ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:40.063629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7b693-ff3d-4a4d-ad1a-796e35f50ef0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:40.156871 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 597/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:19:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:19:40.163551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc779976-e1a4-4188-ad1d-2024f67b20bb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:40.257583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc779976-e1a4-4188-ad1d-2024f67b20bb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:40.289293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3023d2-3106-4a6b-a034-2ee367529941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:40.290162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3023d2-3106-4a6b-a034-2ee367529941 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:40.290712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3023d2-3106-4a6b-a034-2ee367529941 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:40.290712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3023d2-3106-4a6b-a034-2ee367529941 None admin] PATH_INFO: `/v3/projects/b134dba824874e81ae782bedd3dcea6b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:40.291850 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3023d2-3106-4a6b-a034-2ee367529941 None admin] RBAC: Authorizing `identity:get_project(project_id=b134dba824874e81ae782bedd3dcea6b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:40.293267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3023d2-3106-4a6b-a034-2ee367529941 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:40.294958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 587/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:19:40 2022] GET /identity/v3/projects/b134dba824874e81ae782bedd3dcea6b => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:40.301761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b693-ff3d-4a4d-ad1a-796e35f50ef0 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:40.394923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b693-ff3d-4a4d-ad1a-796e35f50ef0 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:40.427243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4d08c-4b34-4e4b-8889-e7f02406e2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:40.427828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4d08c-4b34-4e4b-8889-e7f02406e2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:40.428111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4d08c-4b34-4e4b-8889-e7f02406e2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:40.428386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4d08c-4b34-4e4b-8889-e7f02406e2b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:40.429203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4d08c-4b34-4e4b-8889-e7f02406e2b7 None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=b134dba824874e81ae782bedd3dcea6b, user.id=c27dbffe117841158e0b22d293758c51) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:40.429540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4d08c-4b34-4e4b-8889-e7f02406e2b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:40.430945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4d08c-4b34-4e4b-8889-e7f02406e2b7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:40.436146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 598/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:19:40 2022] GET /identity/v3/role_assignments?user.id=c27dbffe117841158e0b22d293758c51&scope.project.id=b134dba824874e81ae782bedd3dcea6b&role.id=4ae0665802b946be870ab06274297a1d => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:42.650854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625ef0-b16f-4c22-8ac5-bb6697b2bcf7 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:42.651393 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625ef0-b16f-4c22-8ac5-bb6697b2bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:42.651393 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625ef0-b16f-4c22-8ac5-bb6697b2bcf7 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:42.652762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 588/1186] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:42.657953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032bf07-6322-4c4f-b37e-7b05e6aaa547 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:42.659407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032bf07-6322-4c4f-b37e-7b05e6aaa547 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:42.659407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032bf07-6322-4c4f-b37e-7b05e6aaa547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:42.675656 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8032bf07-6322-4c4f-b37e-7b05e6aaa547 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:42.676839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8032bf07-6322-4c4f-b37e-7b05e6aaa547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:42.741161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 599/1187] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:42.766801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6625ef0-b16f-4c22-8ac5-bb6697b2bcf7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:42.865775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6625ef0-b16f-4c22-8ac5-bb6697b2bcf7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:42.900727 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7214-5440-41f5-9188-2dd7c05ce78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:42.901591 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7214-5440-41f5-9188-2dd7c05ce78a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:42.901829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7214-5440-41f5-9188-2dd7c05ce78a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:42.902102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7214-5440-41f5-9188-2dd7c05ce78a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:42.912423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e7214-5440-41f5-9188-2dd7c05ce78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-347e7214-5440-41f5-9188-2dd7c05ce78a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:19:42.919986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:19:42.921099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:19:42.922183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 589/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:19:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:19:42.927563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032bf07-6322-4c4f-b37e-7b05e6aaa547 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:43.021596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032bf07-6322-4c4f-b37e-7b05e6aaa547 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:43.056334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87ea93-f598-4ed9-8adb-d71037a2a2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:43.057001 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87ea93-f598-4ed9-8adb-d71037a2a2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:43.057311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87ea93-f598-4ed9-8adb-d71037a2a2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:43.057591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87ea93-f598-4ed9-8adb-d71037a2a2f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:43.058345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87ea93-f598-4ed9-8adb-d71037a2a2f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:43.058651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87ea93-f598-4ed9-8adb-d71037a2a2f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:43.060023 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87ea93-f598-4ed9-8adb-d71037a2a2f7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:43.068932 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 600/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:19:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:43.074916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7214-5440-41f5-9188-2dd7c05ce78a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:43.168737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7214-5440-41f5-9188-2dd7c05ce78a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:43.199713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a6e7d-8702-4b40-aa4a-ff656368c2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:43.200574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a6e7d-8702-4b40-aa4a-ff656368c2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:43.200861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a6e7d-8702-4b40-aa4a-ff656368c2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:43.201140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a6e7d-8702-4b40-aa4a-ff656368c2f8 None admin] PATH_INFO: `/v3/users/c27dbffe117841158e0b22d293758c51` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:43.202340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a6e7d-8702-4b40-aa4a-ff656368c2f8 None admin] RBAC: Authorizing `identity:get_user(user_id=c27dbffe117841158e0b22d293758c51)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:43.203760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a6e7d-8702-4b40-aa4a-ff656368c2f8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:43.206067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 590/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:43 2022] GET /identity/v3/users/c27dbffe117841158e0b22d293758c51 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:43.211694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87ea93-f598-4ed9-8adb-d71037a2a2f7 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:43.304920 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87ea93-f598-4ed9-8adb-d71037a2a2f7 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:43.337185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8c77f-8c8c-49af-bad9-5958e53dc4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:43.338060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8c77f-8c8c-49af-bad9-5958e53dc4cb None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:43.338344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8c77f-8c8c-49af-bad9-5958e53dc4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:43.338620 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8c77f-8c8c-49af-bad9-5958e53dc4cb None admin] PATH_INFO: `/v3/projects/b134dba824874e81ae782bedd3dcea6b` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:43.339791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8c77f-8c8c-49af-bad9-5958e53dc4cb None admin] RBAC: Authorizing `identity:get_project(project_id=b134dba824874e81ae782bedd3dcea6b)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:43.341204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8c77f-8c8c-49af-bad9-5958e53dc4cb None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:43.342894 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 601/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:19:43 2022] GET /identity/v3/projects/b134dba824874e81ae782bedd3dcea6b => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:43.348709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a6e7d-8702-4b40-aa4a-ff656368c2f8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:43.446560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a6e7d-8702-4b40-aa4a-ff656368c2f8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:43.478457 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73a741-f99b-4d7c-9dea-db4db0079423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:43.479344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73a741-f99b-4d7c-9dea-db4db0079423 None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:43.479631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73a741-f99b-4d7c-9dea-db4db0079423 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:43.479910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73a741-f99b-4d7c-9dea-db4db0079423 None admin] PATH_INFO: `/v3/projects/b134dba824874e81ae782bedd3dcea6b/users/c27dbffe117841158e0b22d293758c51/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:43.481912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73a741-f99b-4d7c-9dea-db4db0079423 None admin] RBAC: Authorizing `identity:create_grant(project_id=b134dba824874e81ae782bedd3dcea6b, user_id=c27dbffe117841158e0b22d293758c51, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:43.483328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73a741-f99b-4d7c-9dea-db4db0079423 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:43.563026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 591/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:19:43 2022] PUT /identity/v3/projects/b134dba824874e81ae782bedd3dcea6b/users/c27dbffe117841158e0b22d293758c51/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:19:45.771655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b665-55d9-4c8e-ba9e-16fbf409847b None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:45.772218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b665-55d9-4c8e-ba9e-16fbf409847b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:45.772218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b665-55d9-4c8e-ba9e-16fbf409847b None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:45.773611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 602/1193] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:19:45.778917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2956aa-6231-4258-a031-34f893324b16 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:45.779335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2956aa-6231-4258-a031-34f893324b16 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:45.779488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2956aa-6231-4258-a031-34f893324b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:45.796288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ef2956aa-6231-4258-a031-34f893324b16 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:19:45.797515 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ef2956aa-6231-4258-a031-34f893324b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:19:45.861947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 592/1194] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:19:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:19:45.885043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423b665-55d9-4c8e-ba9e-16fbf409847b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:45.982013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423b665-55d9-4c8e-ba9e-16fbf409847b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:46.014175 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c83898-468a-462f-927b-349893787899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:46.014973 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c83898-468a-462f-927b-349893787899 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:46.015261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c83898-468a-462f-927b-349893787899 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:46.015541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c83898-468a-462f-927b-349893787899 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:46.026609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c83898-468a-462f-927b-349893787899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-49c83898-468a-462f-927b-349893787899 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:19:46.034615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:19:46.035702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:19:46.036762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 603/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:19:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:19:46.041806 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2956aa-6231-4258-a031-34f893324b16 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:46.134238 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2956aa-6231-4258-a031-34f893324b16 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:46.166128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab172529-82cc-4eb6-94d5-a9aaea085ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:46.166797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab172529-82cc-4eb6-94d5-a9aaea085ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:46.167084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab172529-82cc-4eb6-94d5-a9aaea085ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:46.167364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab172529-82cc-4eb6-94d5-a9aaea085ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:46.168105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab172529-82cc-4eb6-94d5-a9aaea085ce7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:46.168416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab172529-82cc-4eb6-94d5-a9aaea085ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:46.169816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab172529-82cc-4eb6-94d5-a9aaea085ce7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:46.178249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 593/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:46.184064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c83898-468a-462f-927b-349893787899 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:46.278120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c83898-468a-462f-927b-349893787899 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:46.311352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bc51e-54e3-4c68-b01e-691652ef0307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:46.312220 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bc51e-54e3-4c68-b01e-691652ef0307 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:46.312505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bc51e-54e3-4c68-b01e-691652ef0307 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:46.312789 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bc51e-54e3-4c68-b01e-691652ef0307 None admin] PATH_INFO: `/v3/users/c27dbffe117841158e0b22d293758c51` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:46.313989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bc51e-54e3-4c68-b01e-691652ef0307 None admin] RBAC: Authorizing `identity:get_user(user_id=c27dbffe117841158e0b22d293758c51)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:46.315464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bc51e-54e3-4c68-b01e-691652ef0307 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:46.317071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 604/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Thu May 12 20:19:46 2022] GET /identity/v3/users/c27dbffe117841158e0b22d293758c51 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:46.322825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab172529-82cc-4eb6-94d5-a9aaea085ce7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:46.417102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab172529-82cc-4eb6-94d5-a9aaea085ce7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:46.449139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad0db2-1714-403e-8075-b05a591be844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:46.449818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0db2-1714-403e-8075-b05a591be844 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:46.450103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0db2-1714-403e-8075-b05a591be844 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:46.450382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0db2-1714-403e-8075-b05a591be844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:46.516027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad0db2-1714-403e-8075-b05a591be844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:46.518058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad0db2-1714-403e-8075-b05a591be844 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:46.616529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 594/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:19:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:19:46.622619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bc51e-54e3-4c68-b01e-691652ef0307 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:46.716815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bc51e-54e3-4c68-b01e-691652ef0307 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:46.749168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41d29f-f4b2-42e7-adbd-1c5501bf27f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:46.750053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41d29f-f4b2-42e7-adbd-1c5501bf27f2 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:46.750336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41d29f-f4b2-42e7-adbd-1c5501bf27f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:46.750612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41d29f-f4b2-42e7-adbd-1c5501bf27f2 None admin] PATH_INFO: `/v3/projects/b134dba824874e81ae782bedd3dcea6b` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:46.751919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41d29f-f4b2-42e7-adbd-1c5501bf27f2 None admin] RBAC: Authorizing `identity:get_project(project_id=b134dba824874e81ae782bedd3dcea6b)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:46.753618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41d29f-f4b2-42e7-adbd-1c5501bf27f2 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:46.755331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 605/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Thu May 12 20:19:46 2022] GET /identity/v3/projects/b134dba824874e81ae782bedd3dcea6b => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:19:46.761391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad0db2-1714-403e-8075-b05a591be844 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:19:46.858831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad0db2-1714-403e-8075-b05a591be844 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:19:46.900860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5993b5b-af71-40f2-9347-4080c35a6a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:19:46.901469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5993b5b-af71-40f2-9347-4080c35a6a82 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:19:46.901751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5993b5b-af71-40f2-9347-4080c35a6a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:19:46.902023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5993b5b-af71-40f2-9347-4080c35a6a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:19:46.902845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5993b5b-af71-40f2-9347-4080c35a6a82 None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=b134dba824874e81ae782bedd3dcea6b, user.id=c27dbffe117841158e0b22d293758c51) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:19:46.903154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5993b5b-af71-40f2-9347-4080c35a6a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:19:46.904589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5993b5b-af71-40f2-9347-4080c35a6a82 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:19:46.910602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 595/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:19:46 2022] GET /identity/v3/role_assignments?user.id=c27dbffe117841158e0b22d293758c51&scope.project.id=b134dba824874e81ae782bedd3dcea6b&role.id=4ae0665802b946be870ab06274297a1d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:09.972881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cb6a7-874f-46de-bd98-301ce6a3e735 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:09.973549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cb6a7-874f-46de-bd98-301ce6a3e735 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:09.973549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cb6a7-874f-46de-bd98-301ce6a3e735 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:09.974821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 606/1201] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:21:09.980057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e59d3-25a7-4c58-8927-542ece3dee1c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:09.984470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e59d3-25a7-4c58-8927-542ece3dee1c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:09.984470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e59d3-25a7-4c58-8927-542ece3dee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:09.998064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-985e59d3-25a7-4c58-8927-542ece3dee1c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:09.999305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-985e59d3-25a7-4c58-8927-542ece3dee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:10.067800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 596/1202] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:21:10.093006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cb6a7-874f-46de-bd98-301ce6a3e735 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:10.201360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cb6a7-874f-46de-bd98-301ce6a3e735 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:10.242250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78414f8-94d3-49d0-b5ff-5b6f17a40ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:10.243208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78414f8-94d3-49d0-b5ff-5b6f17a40ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:10.243493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78414f8-94d3-49d0-b5ff-5b6f17a40ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:10.243769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78414f8-94d3-49d0-b5ff-5b6f17a40ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:10.255600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78414f8-94d3-49d0-b5ff-5b6f17a40ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:10.257051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78414f8-94d3-49d0-b5ff-5b6f17a40ef5 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-a78414f8-94d3-49d0-b5ff-5b6f17a40ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:10.275866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:10.277085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:10.278155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:10.278155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:10.278155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:10.278155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:10.278155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 607/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:10.283646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e59d3-25a7-4c58-8927-542ece3dee1c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:10.392553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e59d3-25a7-4c58-8927-542ece3dee1c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:10.426989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad5f16-766f-4da1-bdba-77185a6d2f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:10.427701 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad5f16-766f-4da1-bdba-77185a6d2f98 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:10.427991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad5f16-766f-4da1-bdba-77185a6d2f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:10.428273 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad5f16-766f-4da1-bdba-77185a6d2f98 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:10.429005 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad5f16-766f-4da1-bdba-77185a6d2f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:10.429342 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad5f16-766f-4da1-bdba-77185a6d2f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:10.431422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad5f16-766f-4da1-bdba-77185a6d2f98 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:10.442632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 597/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:10.448420 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78414f8-94d3-49d0-b5ff-5b6f17a40ef5 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:10.555356 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78414f8-94d3-49d0-b5ff-5b6f17a40ef5 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:10.592866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ffdc3-50c8-4d6b-8c57-5a5c34a489c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:10.594157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ffdc3-50c8-4d6b-8c57-5a5c34a489c0 None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:10.594442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ffdc3-50c8-4d6b-8c57-5a5c34a489c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:10.594726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ffdc3-50c8-4d6b-8c57-5a5c34a489c0 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:10.595508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ffdc3-50c8-4d6b-8c57-5a5c34a489c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:10.596964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ffdc3-50c8-4d6b-8c57-5a5c34a489c0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:10.677974 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 608/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Thu May 12 20:21:10 2022] POST /identity/v3/users => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:21:13.029013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789be2-3852-4bda-827a-96668fb1188a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:13.029615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789be2-3852-4bda-827a-96668fb1188a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:13.029615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789be2-3852-4bda-827a-96668fb1188a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:13.031564 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 598/1206] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:21:13.037480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb56df1-5cb2-4e9c-b0bd-6b6aa81bf1c6 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:13.037987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb56df1-5cb2-4e9c-b0bd-6b6aa81bf1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:13.038099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb56df1-5cb2-4e9c-b0bd-6b6aa81bf1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:13.055229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-4cb56df1-5cb2-4e9c-b0bd-6b6aa81bf1c6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:13.056509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4cb56df1-5cb2-4e9c-b0bd-6b6aa81bf1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:13.146646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 609/1207] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 20:21:13.170653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63789be2-3852-4bda-827a-96668fb1188a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:13.274022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63789be2-3852-4bda-827a-96668fb1188a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:13.309685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592e92b-e023-42d3-a707-416c74a3cd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:13.310491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592e92b-e023-42d3-a707-416c74a3cd90 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:13.310854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592e92b-e023-42d3-a707-416c74a3cd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:13.311251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592e92b-e023-42d3-a707-416c74a3cd90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:13.326460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592e92b-e023-42d3-a707-416c74a3cd90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-0592e92b-e023-42d3-a707-416c74a3cd90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:21:13.335604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:13.336763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:13.337744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 599/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:21:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:13.343078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb56df1-5cb2-4e9c-b0bd-6b6aa81bf1c6 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:13.455357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb56df1-5cb2-4e9c-b0bd-6b6aa81bf1c6 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:13.497833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155429a7-4bdf-4212-a518-70b108515da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:13.498505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155429a7-4bdf-4212-a518-70b108515da0 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:13.498789 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155429a7-4bdf-4212-a518-70b108515da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:13.499061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155429a7-4bdf-4212-a518-70b108515da0 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:13.501101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155429a7-4bdf-4212-a518-70b108515da0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:13.501436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155429a7-4bdf-4212-a518-70b108515da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:13.502803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155429a7-4bdf-4212-a518-70b108515da0 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:13.511091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 610/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:21:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:13.516905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592e92b-e023-42d3-a707-416c74a3cd90 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:13.623457 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592e92b-e023-42d3-a707-416c74a3cd90 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:13.657552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4d351-4405-4163-9c58-f656d2ae4bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:13.659633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4d351-4405-4163-9c58-f656d2ae4bee None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:13.659633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4d351-4405-4163-9c58-f656d2ae4bee None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:13.659633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4d351-4405-4163-9c58-f656d2ae4bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:13.670338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4d351-4405-4163-9c58-f656d2ae4bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:13.672520 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4d351-4405-4163-9c58-f656d2ae4bee None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-8ac4d351-4405-4163-9c58-f656d2ae4bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:13.690609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:13.691928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:13.692865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:13.692865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:13.692865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:13.692865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:13.692865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 600/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:13.697954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155429a7-4bdf-4212-a518-70b108515da0 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:13.806718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155429a7-4bdf-4212-a518-70b108515da0 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:13.841705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772121db-a14e-4b3a-bc0f-4f1df80cda72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:13.842385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772121db-a14e-4b3a-bc0f-4f1df80cda72 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:13.842674 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772121db-a14e-4b3a-bc0f-4f1df80cda72 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:13.842954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772121db-a14e-4b3a-bc0f-4f1df80cda72 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:13.844214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772121db-a14e-4b3a-bc0f-4f1df80cda72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:13.844544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772121db-a14e-4b3a-bc0f-4f1df80cda72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:13.845964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772121db-a14e-4b3a-bc0f-4f1df80cda72 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:13.858706 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 611/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:13.865517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4d351-4405-4163-9c58-f656d2ae4bee None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:13.970234 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4d351-4405-4163-9c58-f656d2ae4bee None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:14.009714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b9b4-b16e-4948-a471-2f3bf4024d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:14.009714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b9b4-b16e-4948-a471-2f3bf4024d32 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:14.009714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b9b4-b16e-4948-a471-2f3bf4024d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:14.009714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b9b4-b16e-4948-a471-2f3bf4024d32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:14.014038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b9b4-b16e-4948-a471-2f3bf4024d32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:14.015639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b9b4-b16e-4948-a471-2f3bf4024d32 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-13e1b9b4-b16e-4948-a471-2f3bf4024d32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:21:14.029881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:14.032151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:14.033471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 601/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:14.038616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772121db-a14e-4b3a-bc0f-4f1df80cda72 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:14.146636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772121db-a14e-4b3a-bc0f-4f1df80cda72 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:14.183490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2e9b0-110c-4366-aff7-dcc233f0fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:14.191907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2e9b0-110c-4366-aff7-dcc233f0fc1a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:14.191907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2e9b0-110c-4366-aff7-dcc233f0fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:14.191907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2e9b0-110c-4366-aff7-dcc233f0fc1a None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:14.191907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2e9b0-110c-4366-aff7-dcc233f0fc1a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:14.191907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2e9b0-110c-4366-aff7-dcc233f0fc1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:14.191907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2e9b0-110c-4366-aff7-dcc233f0fc1a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:14.206491 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 612/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 12 20:21:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:14.214003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b9b4-b16e-4948-a471-2f3bf4024d32 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:14.315557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b9b4-b16e-4948-a471-2f3bf4024d32 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:14.349038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bf695-eec8-4532-bc81-26b02883e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:14.349759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bf695-eec8-4532-bc81-26b02883e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:14.350047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bf695-eec8-4532-bc81-26b02883e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:14.350326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bf695-eec8-4532-bc81-26b02883e1e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:14.418948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bf695-eec8-4532-bc81-26b02883e1e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:14.420315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bf695-eec8-4532-bc81-26b02883e1e7 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:14.519723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 602/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:21:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:21:14.525557 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2e9b0-110c-4366-aff7-dcc233f0fc1a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:14.624912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2e9b0-110c-4366-aff7-dcc233f0fc1a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:14.660600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32ce22-0461-4d58-a8b1-09e98df94616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:14.661504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ce22-0461-4d58-a8b1-09e98df94616 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:14.662065 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ce22-0461-4d58-a8b1-09e98df94616 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:14.662478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ce22-0461-4d58-a8b1-09e98df94616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:14.674694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32ce22-0461-4d58-a8b1-09e98df94616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:14.676078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32ce22-0461-4d58-a8b1-09e98df94616 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-fd32ce22-0461-4d58-a8b1-09e98df94616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:14.694366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:14.695520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:14.696611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:14.696611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:14.696611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:14.696611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:14.696611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 613/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:14.701451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bf695-eec8-4532-bc81-26b02883e1e7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:14.808196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bf695-eec8-4532-bc81-26b02883e1e7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:14.844523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82d78a-0a7b-441f-b767-1638f83e296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:14.845192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d78a-0a7b-441f-b767-1638f83e296a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:14.845632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d78a-0a7b-441f-b767-1638f83e296a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:14.845921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82d78a-0a7b-441f-b767-1638f83e296a None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:14.846646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d78a-0a7b-441f-b767-1638f83e296a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:14.846953 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d78a-0a7b-441f-b767-1638f83e296a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:14.848444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82d78a-0a7b-441f-b767-1638f83e296a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:14.860961 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 603/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:14.866884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32ce22-0461-4d58-a8b1-09e98df94616 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:14.981489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32ce22-0461-4d58-a8b1-09e98df94616 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:15.017756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164acee-401f-4736-b5a8-7a5c69965653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:15.018557 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164acee-401f-4736-b5a8-7a5c69965653 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:15.018843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164acee-401f-4736-b5a8-7a5c69965653 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:15.019121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164acee-401f-4736-b5a8-7a5c69965653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:15.026110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164acee-401f-4736-b5a8-7a5c69965653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:15.027727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164acee-401f-4736-b5a8-7a5c69965653 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-6164acee-401f-4736-b5a8-7a5c69965653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:21:15.044501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:15.046110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:15.047055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:21:15.047055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:21:15.047055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:21:15.047055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:21:15.047055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:21:15.047055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:21:15.047055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:15.047055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:15.047055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 614/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:21:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:15.051893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82d78a-0a7b-441f-b767-1638f83e296a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:15.157722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82d78a-0a7b-441f-b767-1638f83e296a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:15.190609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8fb97-f471-4039-bedd-11bd6628ede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:15.191285 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8fb97-f471-4039-bedd-11bd6628ede5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:15.191565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8fb97-f471-4039-bedd-11bd6628ede5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:15.191840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8fb97-f471-4039-bedd-11bd6628ede5 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:15.192629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8fb97-f471-4039-bedd-11bd6628ede5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:15.192937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8fb97-f471-4039-bedd-11bd6628ede5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:15.194422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8fb97-f471-4039-bedd-11bd6628ede5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:15.207809 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 604/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:21:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:15.213931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164acee-401f-4736-b5a8-7a5c69965653 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:15.317996 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164acee-401f-4736-b5a8-7a5c69965653 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:15.351406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f757da-d392-4547-af03-607ec5409ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:15.352082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f757da-d392-4547-af03-607ec5409ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:15.356881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f757da-d392-4547-af03-607ec5409ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:15.356881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f757da-d392-4547-af03-607ec5409ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:15.356881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f757da-d392-4547-af03-607ec5409ca8 None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=65431a33849249ed8686d03b0c2e3a5b) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:15.356881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f757da-d392-4547-af03-607ec5409ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:15.356881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f757da-d392-4547-af03-607ec5409ca8 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:15.361155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 615/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:21:15 2022] GET /identity/v3/role_assignments?user.id=65431a33849249ed8686d03b0c2e3a5b&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:17.701203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0563-ee73-47b0-bfcf-2d6e4ec99567 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:17.702271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0563-ee73-47b0-bfcf-2d6e4ec99567 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:17.702271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0563-ee73-47b0-bfcf-2d6e4ec99567 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:17.703368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 605/1220] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:21:17.709092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb57f1f-af79-4d5b-a290-dbd101bfccde None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:17.709928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb57f1f-af79-4d5b-a290-dbd101bfccde None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:17.709928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb57f1f-af79-4d5b-a290-dbd101bfccde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:17.728059 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-2bb57f1f-af79-4d5b-a290-dbd101bfccde None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:17.729286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2bb57f1f-af79-4d5b-a290-dbd101bfccde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:17.802928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 616/1221] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:21:17.826570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c0563-ee73-47b0-bfcf-2d6e4ec99567 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:17.955308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c0563-ee73-47b0-bfcf-2d6e4ec99567 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:17.990514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299f5c8-f00a-460d-8a5a-3e69cb27b8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:17.991245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299f5c8-f00a-460d-8a5a-3e69cb27b8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:17.991596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299f5c8-f00a-460d-8a5a-3e69cb27b8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:17.991840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299f5c8-f00a-460d-8a5a-3e69cb27b8e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:18.003063 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299f5c8-f00a-460d-8a5a-3e69cb27b8e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-9299f5c8-f00a-460d-8a5a-3e69cb27b8e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:21:18.011021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:18.012155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:18.013680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 606/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:21:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:18.018912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb57f1f-af79-4d5b-a290-dbd101bfccde None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:18.126204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb57f1f-af79-4d5b-a290-dbd101bfccde None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:18.164997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2cd2e-6ab1-4fbd-bb9c-7657cf453597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:18.165710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2cd2e-6ab1-4fbd-bb9c-7657cf453597 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:18.165998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2cd2e-6ab1-4fbd-bb9c-7657cf453597 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:18.166277 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2cd2e-6ab1-4fbd-bb9c-7657cf453597 None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:18.167036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2cd2e-6ab1-4fbd-bb9c-7657cf453597 None admin] RBAC: Adding query filter params (name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:18.167345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2cd2e-6ab1-4fbd-bb9c-7657cf453597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:18.168719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2cd2e-6ab1-4fbd-bb9c-7657cf453597 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:18.177178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 617/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:21:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:21:18.183011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299f5c8-f00a-460d-8a5a-3e69cb27b8e7 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:18.318320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299f5c8-f00a-460d-8a5a-3e69cb27b8e7 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:18.359789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7e235-48c0-415a-a2d4-e770de7e88ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:18.360670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7e235-48c0-415a-a2d4-e770de7e88ff None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:18.360955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7e235-48c0-415a-a2d4-e770de7e88ff None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:18.361229 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7e235-48c0-415a-a2d4-e770de7e88ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:18.372670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7e235-48c0-415a-a2d4-e770de7e88ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:18.374179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7e235-48c0-415a-a2d4-e770de7e88ff None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-55b7e235-48c0-415a-a2d4-e770de7e88ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:18.392595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:18.393804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:18.395100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:18.395100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:18.395100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:18.395100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:18.395100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 607/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:18.400247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2cd2e-6ab1-4fbd-bb9c-7657cf453597 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:18.510747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2cd2e-6ab1-4fbd-bb9c-7657cf453597 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:18.545959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a484-1943-435b-b99e-cb15702cb8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:18.546664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a484-1943-435b-b99e-cb15702cb8aa None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:18.546948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a484-1943-435b-b99e-cb15702cb8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:18.547228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a484-1943-435b-b99e-cb15702cb8aa None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:18.547948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411a484-1943-435b-b99e-cb15702cb8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:18.548257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411a484-1943-435b-b99e-cb15702cb8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:18.549654 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411a484-1943-435b-b99e-cb15702cb8aa None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:18.563857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 618/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:18.570504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7e235-48c0-415a-a2d4-e770de7e88ff None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:18.690389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7e235-48c0-415a-a2d4-e770de7e88ff None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:18.728268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437b4a6-71a8-41b7-93b7-51a82c4e5afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:18.729131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437b4a6-71a8-41b7-93b7-51a82c4e5afc None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:18.729458 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437b4a6-71a8-41b7-93b7-51a82c4e5afc None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:18.729741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437b4a6-71a8-41b7-93b7-51a82c4e5afc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:18.739676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437b4a6-71a8-41b7-93b7-51a82c4e5afc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:18.741153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437b4a6-71a8-41b7-93b7-51a82c4e5afc None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-d437b4a6-71a8-41b7-93b7-51a82c4e5afc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:21:18.757938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:18.759280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:18.760758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 608/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:18.766843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a484-1943-435b-b99e-cb15702cb8aa None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:18.876330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a484-1943-435b-b99e-cb15702cb8aa None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:18.911591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4403f7-3526-4ca0-8aa8-4fa6d65bbd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:18.912284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4403f7-3526-4ca0-8aa8-4fa6d65bbd36 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:18.912572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4403f7-3526-4ca0-8aa8-4fa6d65bbd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:18.912853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4403f7-3526-4ca0-8aa8-4fa6d65bbd36 None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:18.913768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4403f7-3526-4ca0-8aa8-4fa6d65bbd36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:18.914082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4403f7-3526-4ca0-8aa8-4fa6d65bbd36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:18.915546 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4403f7-3526-4ca0-8aa8-4fa6d65bbd36 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:18.935832 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 619/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 12 20:21:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:18.942680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437b4a6-71a8-41b7-93b7-51a82c4e5afc None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:19.045230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437b4a6-71a8-41b7-93b7-51a82c4e5afc None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:19.083872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd01b6-7da4-4d8d-8d12-61043f138f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:19.084681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd01b6-7da4-4d8d-8d12-61043f138f82 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:19.084968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd01b6-7da4-4d8d-8d12-61043f138f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:19.085254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd01b6-7da4-4d8d-8d12-61043f138f82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:19.099567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd01b6-7da4-4d8d-8d12-61043f138f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:19.101660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd01b6-7da4-4d8d-8d12-61043f138f82 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-36bd01b6-7da4-4d8d-8d12-61043f138f82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:19.122877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:19.123837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:19.124873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:19.124873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:19.124873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:19.124873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:19.124873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 609/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:19.129946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4403f7-3526-4ca0-8aa8-4fa6d65bbd36 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:19.237960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4403f7-3526-4ca0-8aa8-4fa6d65bbd36 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:19.273342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aae91-9e55-483b-a459-3573b0609a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:19.274127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aae91-9e55-483b-a459-3573b0609a90 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:19.274415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aae91-9e55-483b-a459-3573b0609a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:19.274696 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aae91-9e55-483b-a459-3573b0609a90 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:19.275427 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aae91-9e55-483b-a459-3573b0609a90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:19.275736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aae91-9e55-483b-a459-3573b0609a90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:19.277234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aae91-9e55-483b-a459-3573b0609a90 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:19.292604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 620/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:19.299971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd01b6-7da4-4d8d-8d12-61043f138f82 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:19.401728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd01b6-7da4-4d8d-8d12-61043f138f82 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:19.439263 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da607c-5007-4991-8fb7-640e52304c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:19.440655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da607c-5007-4991-8fb7-640e52304c2c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:19.441074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da607c-5007-4991-8fb7-640e52304c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:19.441562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da607c-5007-4991-8fb7-640e52304c2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:19.451155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da607c-5007-4991-8fb7-640e52304c2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:19.453316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da607c-5007-4991-8fb7-640e52304c2c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-68da607c-5007-4991-8fb7-640e52304c2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:21:19.467522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:19.468618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:19.469614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:21:19.469614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:21:19.469614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:21:19.469614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:21:19.469614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:21:19.469614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:21:19.469614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:19.469614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:19.469614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 610/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:21:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:19.475500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aae91-9e55-483b-a459-3573b0609a90 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:19.576507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aae91-9e55-483b-a459-3573b0609a90 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:19.610102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223a1d5-23f6-4ecf-82fe-cae4091d03ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:19.610775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a1d5-23f6-4ecf-82fe-cae4091d03ad None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:19.611062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a1d5-23f6-4ecf-82fe-cae4091d03ad None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:19.611343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a1d5-23f6-4ecf-82fe-cae4091d03ad None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:19.612146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a1d5-23f6-4ecf-82fe-cae4091d03ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:19.612464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a1d5-23f6-4ecf-82fe-cae4091d03ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:19.613986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a1d5-23f6-4ecf-82fe-cae4091d03ad None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:19.627412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 621/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:21:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:19.633985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da607c-5007-4991-8fb7-640e52304c2c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:19.739798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da607c-5007-4991-8fb7-640e52304c2c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:19.776531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac4f33-d3ab-4d52-8c2b-47a9fdd523ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:19.777643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac4f33-d3ab-4d52-8c2b-47a9fdd523ef None admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:19.778117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac4f33-d3ab-4d52-8c2b-47a9fdd523ef None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:19.778600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac4f33-d3ab-4d52-8c2b-47a9fdd523ef None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/65431a33849249ed8686d03b0c2e3a5b/roles/5c0bc4258a8348c7afa8b9b712d5cd0b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:19.795575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac4f33-d3ab-4d52-8c2b-47a9fdd523ef None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=65431a33849249ed8686d03b0c2e3a5b, role_id=5c0bc4258a8348c7afa8b9b712d5cd0b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:19.797915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac4f33-d3ab-4d52-8c2b-47a9fdd523ef None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:20.050848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 611/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:21:19 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/65431a33849249ed8686d03b0c2e3a5b/roles/5c0bc4258a8348c7afa8b9b712d5cd0b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:21:22.447837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3cb31-d7c7-4347-9a2f-d961c3e044a3 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:22.448418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3cb31-d7c7-4347-9a2f-d961c3e044a3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:22.448418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3cb31-d7c7-4347-9a2f-d961c3e044a3 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:22.449836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 622/1233] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:21:22.455844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367ee2a-6280-4d03-a984-9315158b575f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:22.456275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367ee2a-6280-4d03-a984-9315158b575f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:22.456410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367ee2a-6280-4d03-a984-9315158b575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:22.474451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5367ee2a-6280-4d03-a984-9315158b575f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:22.475838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5367ee2a-6280-4d03-a984-9315158b575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:22.545387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 612/1234] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:21:22.572104 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3cb31-d7c7-4347-9a2f-d961c3e044a3 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:22.676775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3cb31-d7c7-4347-9a2f-d961c3e044a3 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:22.718753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738ee7-4d6c-45e5-a07d-e066eea5f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:22.719471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738ee7-4d6c-45e5-a07d-e066eea5f575 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:22.719757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738ee7-4d6c-45e5-a07d-e066eea5f575 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:22.720035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738ee7-4d6c-45e5-a07d-e066eea5f575 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:22.730483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07738ee7-4d6c-45e5-a07d-e066eea5f575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-07738ee7-4d6c-45e5-a07d-e066eea5f575 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:21:22.738397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:22.739619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:22.740736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 623/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Thu May 12 20:21:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:22.745940 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367ee2a-6280-4d03-a984-9315158b575f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:22.851609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367ee2a-6280-4d03-a984-9315158b575f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:22.886151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a277827-c21d-4503-9960-a99ae81c9c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:22.886834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277827-c21d-4503-9960-a99ae81c9c90 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:22.887117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277827-c21d-4503-9960-a99ae81c9c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:22.887395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a277827-c21d-4503-9960-a99ae81c9c90 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:22.888139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a277827-c21d-4503-9960-a99ae81c9c90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:22.888445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a277827-c21d-4503-9960-a99ae81c9c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:22.890655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a277827-c21d-4503-9960-a99ae81c9c90 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:22.898416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 613/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Thu May 12 20:21:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:22.904575 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738ee7-4d6c-45e5-a07d-e066eea5f575 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:23.008285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738ee7-4d6c-45e5-a07d-e066eea5f575 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:23.051051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72a2e5-25aa-4e79-8009-d83d263ee7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:23.051874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72a2e5-25aa-4e79-8009-d83d263ee7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:23.052162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72a2e5-25aa-4e79-8009-d83d263ee7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:23.052436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72a2e5-25aa-4e79-8009-d83d263ee7d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:23.064872 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72a2e5-25aa-4e79-8009-d83d263ee7d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:23.073361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72a2e5-25aa-4e79-8009-d83d263ee7d3 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-0d72a2e5-25aa-4e79-8009-d83d263ee7d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:23.084266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:23.085417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:23.086803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:23.086803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:23.086803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:23.086803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:23.086803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 624/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:23.091367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a277827-c21d-4503-9960-a99ae81c9c90 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:23.191010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a277827-c21d-4503-9960-a99ae81c9c90 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:23.223178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecc3bc-64e3-48af-880a-bbda00d09f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:23.223865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecc3bc-64e3-48af-880a-bbda00d09f8a None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:23.224147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecc3bc-64e3-48af-880a-bbda00d09f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:23.224418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecc3bc-64e3-48af-880a-bbda00d09f8a None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:23.225147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecc3bc-64e3-48af-880a-bbda00d09f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:23.225487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecc3bc-64e3-48af-880a-bbda00d09f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:23.226849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecc3bc-64e3-48af-880a-bbda00d09f8a None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:23.239351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 614/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:23.245018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72a2e5-25aa-4e79-8009-d83d263ee7d3 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:23.352610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72a2e5-25aa-4e79-8009-d83d263ee7d3 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:23.391724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f0822-b456-4a70-8b73-b454dbe00b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:23.392536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f0822-b456-4a70-8b73-b454dbe00b66 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:23.392823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f0822-b456-4a70-8b73-b454dbe00b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:23.393102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f0822-b456-4a70-8b73-b454dbe00b66 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:23.401043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f0822-b456-4a70-8b73-b454dbe00b66 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:23.402604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f0822-b456-4a70-8b73-b454dbe00b66 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-4d0f0822-b456-4a70-8b73-b454dbe00b66 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:21:23.417057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:23.418296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:23.419451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 625/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:23.424742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecc3bc-64e3-48af-880a-bbda00d09f8a None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:23.524822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecc3bc-64e3-48af-880a-bbda00d09f8a None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:23.558892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5c6c7-6468-4761-a1f6-191d6c89d82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:23.559600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5c6c7-6468-4761-a1f6-191d6c89d82f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:23.559899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5c6c7-6468-4761-a1f6-191d6c89d82f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:23.560157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5c6c7-6468-4761-a1f6-191d6c89d82f None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:23.561030 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5c6c7-6468-4761-a1f6-191d6c89d82f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:23.561361 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5c6c7-6468-4761-a1f6-191d6c89d82f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:23.564140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5c6c7-6468-4761-a1f6-191d6c89d82f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:23.580773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 615/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 12 20:21:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:23.586660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f0822-b456-4a70-8b73-b454dbe00b66 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:23.689812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f0822-b456-4a70-8b73-b454dbe00b66 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:23.731586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53599e-70a8-4256-8eb2-0cf5b0e1492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:23.732294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53599e-70a8-4256-8eb2-0cf5b0e1492d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:23.732578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53599e-70a8-4256-8eb2-0cf5b0e1492d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:23.732853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53599e-70a8-4256-8eb2-0cf5b0e1492d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:23.802815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53599e-70a8-4256-8eb2-0cf5b0e1492d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:23.804322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53599e-70a8-4256-8eb2-0cf5b0e1492d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:23.905582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 626/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:21:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:21:23.911757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5c6c7-6468-4761-a1f6-191d6c89d82f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:24.010861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5c6c7-6468-4761-a1f6-191d6c89d82f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:24.044437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28331d-39bf-4010-824f-c5f46101a357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:24.045229 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28331d-39bf-4010-824f-c5f46101a357 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:24.045539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28331d-39bf-4010-824f-c5f46101a357 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:24.045814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28331d-39bf-4010-824f-c5f46101a357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:24.056189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28331d-39bf-4010-824f-c5f46101a357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:24.057665 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28331d-39bf-4010-824f-c5f46101a357 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-2b28331d-39bf-4010-824f-c5f46101a357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:24.075160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:24.076295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:24.077785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:24.077785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:24.077785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:24.077785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:24.077785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 616/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:24.083362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53599e-70a8-4256-8eb2-0cf5b0e1492d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:24.183337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53599e-70a8-4256-8eb2-0cf5b0e1492d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:24.216692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387aa2e-8f2c-40c0-9f02-6217fbb9d586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:24.217390 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387aa2e-8f2c-40c0-9f02-6217fbb9d586 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:24.217677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387aa2e-8f2c-40c0-9f02-6217fbb9d586 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:24.218045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387aa2e-8f2c-40c0-9f02-6217fbb9d586 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:24.218819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387aa2e-8f2c-40c0-9f02-6217fbb9d586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:24.219123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387aa2e-8f2c-40c0-9f02-6217fbb9d586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:24.220483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387aa2e-8f2c-40c0-9f02-6217fbb9d586 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:24.231791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 627/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:24.238180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28331d-39bf-4010-824f-c5f46101a357 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:24.337061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28331d-39bf-4010-824f-c5f46101a357 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:24.372164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaca5a-8914-4b44-97e1-629023f355d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:24.372963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaca5a-8914-4b44-97e1-629023f355d6 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:24.373247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaca5a-8914-4b44-97e1-629023f355d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:24.373557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaca5a-8914-4b44-97e1-629023f355d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:24.380470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaca5a-8914-4b44-97e1-629023f355d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:24.381968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaca5a-8914-4b44-97e1-629023f355d6 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-1acaca5a-8914-4b44-97e1-629023f355d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:21:24.396083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:24.397341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:24.398775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:21:24.398775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:21:24.398775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:21:24.398775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:21:24.398775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:21:24.398775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:21:24.398775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:24.398775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:24.398775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 617/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:21:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:24.403352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387aa2e-8f2c-40c0-9f02-6217fbb9d586 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:24.504555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387aa2e-8f2c-40c0-9f02-6217fbb9d586 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:24.539744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6685a-735a-4823-bec9-c2d0de6529cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:24.540418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6685a-735a-4823-bec9-c2d0de6529cd None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:24.540707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6685a-735a-4823-bec9-c2d0de6529cd None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:24.540987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6685a-735a-4823-bec9-c2d0de6529cd None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:24.541829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6685a-735a-4823-bec9-c2d0de6529cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:24.542133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6685a-735a-4823-bec9-c2d0de6529cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:24.543567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6685a-735a-4823-bec9-c2d0de6529cd None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:24.556415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 628/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:21:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:24.563165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaca5a-8914-4b44-97e1-629023f355d6 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:24.665083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaca5a-8914-4b44-97e1-629023f355d6 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:24.699469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813ef1-1393-4ed2-81a3-c7fb41503c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:24.700123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813ef1-1393-4ed2-81a3-c7fb41503c36 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:24.700411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813ef1-1393-4ed2-81a3-c7fb41503c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:24.700688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813ef1-1393-4ed2-81a3-c7fb41503c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:24.701545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813ef1-1393-4ed2-81a3-c7fb41503c36 None admin] RBAC: Adding query filter params (role.id=5c0bc4258a8348c7afa8b9b712d5cd0b, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=65431a33849249ed8686d03b0c2e3a5b) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:24.701857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813ef1-1393-4ed2-81a3-c7fb41503c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:24.703429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813ef1-1393-4ed2-81a3-c7fb41503c36 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:24.709331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 618/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:21:24 2022] GET /identity/v3/role_assignments?user.id=65431a33849249ed8686d03b0c2e3a5b&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=5c0bc4258a8348c7afa8b9b712d5cd0b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:27.075231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b1905-796c-4374-ad44-0e03fbca81e7 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:27.075761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b1905-796c-4374-ad44-0e03fbca81e7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:27.075761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b1905-796c-4374-ad44-0e03fbca81e7 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:27.077153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 629/1247] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:21:27.082694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56fc74-b0db-4c8b-81c6-221ee41f6061 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:27.083153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56fc74-b0db-4c8b-81c6-221ee41f6061 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:27.083252 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56fc74-b0db-4c8b-81c6-221ee41f6061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:27.100260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-aa56fc74-b0db-4c8b-81c6-221ee41f6061 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:27.101492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-aa56fc74-b0db-4c8b-81c6-221ee41f6061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:27.169447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 619/1248] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:21:27.194793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b1905-796c-4374-ad44-0e03fbca81e7 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:27.303328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b1905-796c-4374-ad44-0e03fbca81e7 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:27.337960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c095a33-af16-4fe5-9521-7a2a073f8a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:27.338787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095a33-af16-4fe5-9521-7a2a073f8a4f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:27.339069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095a33-af16-4fe5-9521-7a2a073f8a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:27.339343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095a33-af16-4fe5-9521-7a2a073f8a4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:27.350535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c095a33-af16-4fe5-9521-7a2a073f8a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-4c095a33-af16-4fe5-9521-7a2a073f8a4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:21:27.358043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:27.360241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:27.361365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 630/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:21:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:27.366250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56fc74-b0db-4c8b-81c6-221ee41f6061 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:27.461137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56fc74-b0db-4c8b-81c6-221ee41f6061 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:27.496152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0b8e9-35c0-4db0-bfcb-dbfcf7a6022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:27.506323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0b8e9-35c0-4db0-bfcb-dbfcf7a6022f None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:27.506323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0b8e9-35c0-4db0-bfcb-dbfcf7a6022f None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:27.506323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0b8e9-35c0-4db0-bfcb-dbfcf7a6022f None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:27.506323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0b8e9-35c0-4db0-bfcb-dbfcf7a6022f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:27.506323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0b8e9-35c0-4db0-bfcb-dbfcf7a6022f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:27.506323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0b8e9-35c0-4db0-bfcb-dbfcf7a6022f None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:27.508651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 620/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:21:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:27.514403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c095a33-af16-4fe5-9521-7a2a073f8a4f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:27.617092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c095a33-af16-4fe5-9521-7a2a073f8a4f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:27.654444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd038e03-9c1b-43f0-a4e3-a81062977856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:27.655823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd038e03-9c1b-43f0-a4e3-a81062977856 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:27.656302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd038e03-9c1b-43f0-a4e3-a81062977856 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:27.656777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd038e03-9c1b-43f0-a4e3-a81062977856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:27.667948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd038e03-9c1b-43f0-a4e3-a81062977856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:27.669714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd038e03-9c1b-43f0-a4e3-a81062977856 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-bd038e03-9c1b-43f0-a4e3-a81062977856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:27.689072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:27.690235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:27.691336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:27.691336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:27.691336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:27.691336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:27.691336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 631/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:27.696519 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0b8e9-35c0-4db0-bfcb-dbfcf7a6022f None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:27.812684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0b8e9-35c0-4db0-bfcb-dbfcf7a6022f None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:27.845927 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef143aeb-15c5-4605-8806-84f8d954f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:27.846596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef143aeb-15c5-4605-8806-84f8d954f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:27.852902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef143aeb-15c5-4605-8806-84f8d954f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:27.852902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef143aeb-15c5-4605-8806-84f8d954f3c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:27.852902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef143aeb-15c5-4605-8806-84f8d954f3c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:27.852902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef143aeb-15c5-4605-8806-84f8d954f3c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:27.852902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef143aeb-15c5-4605-8806-84f8d954f3c8 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:27.861700 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 621/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:27.867353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd038e03-9c1b-43f0-a4e3-a81062977856 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:27.971490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd038e03-9c1b-43f0-a4e3-a81062977856 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:28.004959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239f999-29f2-428b-ba76-715edeedff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:28.005839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239f999-29f2-428b-ba76-715edeedff70 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:28.006121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239f999-29f2-428b-ba76-715edeedff70 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:28.006396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239f999-29f2-428b-ba76-715edeedff70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:28.013960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239f999-29f2-428b-ba76-715edeedff70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:28.016119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239f999-29f2-428b-ba76-715edeedff70 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-6239f999-29f2-428b-ba76-715edeedff70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:21:28.031121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:28.032181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:28.033174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 632/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:28.038228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef143aeb-15c5-4605-8806-84f8d954f3c8 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:28.135997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef143aeb-15c5-4605-8806-84f8d954f3c8 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:28.170142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810a9cc-3b92-4183-b0dd-62f5f1ec8ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:28.170862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810a9cc-3b92-4183-b0dd-62f5f1ec8ffe None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:28.171220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810a9cc-3b92-4183-b0dd-62f5f1ec8ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:28.171580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810a9cc-3b92-4183-b0dd-62f5f1ec8ffe None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:28.172435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810a9cc-3b92-4183-b0dd-62f5f1ec8ffe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:28.172749 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810a9cc-3b92-4183-b0dd-62f5f1ec8ffe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:28.174210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810a9cc-3b92-4183-b0dd-62f5f1ec8ffe None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:28.192140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 622/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 12 20:21:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:28.198192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239f999-29f2-428b-ba76-715edeedff70 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:28.298875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239f999-29f2-428b-ba76-715edeedff70 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:28.331884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881507-dd4d-4aa4-8e6d-96f09028ec75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:28.332541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881507-dd4d-4aa4-8e6d-96f09028ec75 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:28.332828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881507-dd4d-4aa4-8e6d-96f09028ec75 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:28.333106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881507-dd4d-4aa4-8e6d-96f09028ec75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:28.415989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21881507-dd4d-4aa4-8e6d-96f09028ec75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:28.417400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21881507-dd4d-4aa4-8e6d-96f09028ec75 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:28.515819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 633/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:21:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:21:28.521747 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810a9cc-3b92-4183-b0dd-62f5f1ec8ffe None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:28.621443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810a9cc-3b92-4183-b0dd-62f5f1ec8ffe None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:28.656629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bf730-f3cb-45d4-9b07-0843adc8aaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:28.657521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bf730-f3cb-45d4-9b07-0843adc8aaef None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:28.657809 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bf730-f3cb-45d4-9b07-0843adc8aaef None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:28.658084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bf730-f3cb-45d4-9b07-0843adc8aaef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:28.667845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bf730-f3cb-45d4-9b07-0843adc8aaef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:28.669229 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bf730-f3cb-45d4-9b07-0843adc8aaef None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-748bf730-f3cb-45d4-9b07-0843adc8aaef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:28.688482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:28.701619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:28.703363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:28.703363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:28.703363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:28.703363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:28.703363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 623/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:28.703705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881507-dd4d-4aa4-8e6d-96f09028ec75 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:28.797004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881507-dd4d-4aa4-8e6d-96f09028ec75 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:28.830931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cc147-e695-4a6e-a650-f772d4f9d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:28.831596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc147-e695-4a6e-a650-f772d4f9d543 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:28.831881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc147-e695-4a6e-a650-f772d4f9d543 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:28.832159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc147-e695-4a6e-a650-f772d4f9d543 None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:28.832885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cc147-e695-4a6e-a650-f772d4f9d543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:28.833190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cc147-e695-4a6e-a650-f772d4f9d543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:28.834578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cc147-e695-4a6e-a650-f772d4f9d543 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:28.847041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 634/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:28.853129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bf730-f3cb-45d4-9b07-0843adc8aaef None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:28.952435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bf730-f3cb-45d4-9b07-0843adc8aaef None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:28.988114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d108ef1-9895-4892-9acf-4c63971bff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:28.988910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d108ef1-9895-4892-9acf-4c63971bff43 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:28.989191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d108ef1-9895-4892-9acf-4c63971bff43 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:28.989515 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d108ef1-9895-4892-9acf-4c63971bff43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:28.996360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d108ef1-9895-4892-9acf-4c63971bff43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:28.998111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d108ef1-9895-4892-9acf-4c63971bff43 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-4d108ef1-9895-4892-9acf-4c63971bff43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:21:29.012689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:29.020666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:29.021849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:21:29.021849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:21:29.021849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:21:29.021849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:21:29.021849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:21:29.021849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:21:29.021849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:29.021849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:29.021849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 624/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:21:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:29.022454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cc147-e695-4a6e-a650-f772d4f9d543 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:29.118992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cc147-e695-4a6e-a650-f772d4f9d543 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:29.152528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21d3c7-8648-4849-a6a8-a435dfda3320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:29.153189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21d3c7-8648-4849-a6a8-a435dfda3320 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:29.153508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21d3c7-8648-4849-a6a8-a435dfda3320 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:29.153792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21d3c7-8648-4849-a6a8-a435dfda3320 None admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:29.154590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21d3c7-8648-4849-a6a8-a435dfda3320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:29.154899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21d3c7-8648-4849-a6a8-a435dfda3320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:29.156986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21d3c7-8648-4849-a6a8-a435dfda3320 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:29.168728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 635/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:21:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:29.175920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d108ef1-9895-4892-9acf-4c63971bff43 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:29.272959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d108ef1-9895-4892-9acf-4c63971bff43 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:29.304953 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5116c86-2b4a-4d89-9f44-276dd72154ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:29.305633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5116c86-2b4a-4d89-9f44-276dd72154ac None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:29.305924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5116c86-2b4a-4d89-9f44-276dd72154ac None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:29.306202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5116c86-2b4a-4d89-9f44-276dd72154ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:29.307029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5116c86-2b4a-4d89-9f44-276dd72154ac None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=65431a33849249ed8686d03b0c2e3a5b) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:29.307343 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5116c86-2b4a-4d89-9f44-276dd72154ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:29.308762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5116c86-2b4a-4d89-9f44-276dd72154ac None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:29.314318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 625/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:21:29 2022] GET /identity/v3/role_assignments?user.id=65431a33849249ed8686d03b0c2e3a5b&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=4ae0665802b946be870ab06274297a1d => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:31.596265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a23ec-d0c2-455b-b6cf-14ebc918f172 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:31.596835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a23ec-d0c2-455b-b6cf-14ebc918f172 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:31.596835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a23ec-d0c2-455b-b6cf-14ebc918f172 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:31.598202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 636/1261] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:21:31.603572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2a97-cb2d-4470-bd47-3b4ade9afe98 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:31.604043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2a97-cb2d-4470-bd47-3b4ade9afe98 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:31.604158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2a97-cb2d-4470-bd47-3b4ade9afe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:31.627406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2cee2a97-cb2d-4470-bd47-3b4ade9afe98 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:31.628708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2cee2a97-cb2d-4470-bd47-3b4ade9afe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:31.698890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 626/1262] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:21:31.724431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a23ec-d0c2-455b-b6cf-14ebc918f172 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:31.837113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a23ec-d0c2-455b-b6cf-14ebc918f172 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:31.875361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cdde8-e882-422d-ab3c-1c8723801fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:31.876212 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cdde8-e882-422d-ab3c-1c8723801fde None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:31.876498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cdde8-e882-422d-ab3c-1c8723801fde None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:31.876773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cdde8-e882-422d-ab3c-1c8723801fde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:31.887192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cdde8-e882-422d-ab3c-1c8723801fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-e73cdde8-e882-422d-ab3c-1c8723801fde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:21:31.895647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:31.896805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:31.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 637/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:31.903095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee2a97-cb2d-4470-bd47-3b4ade9afe98 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:32.007717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee2a97-cb2d-4470-bd47-3b4ade9afe98 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:32.043625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed95317-4361-4855-8cac-140731f8f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:32.044297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed95317-4361-4855-8cac-140731f8f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:32.044583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed95317-4361-4855-8cac-140731f8f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:32.044864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed95317-4361-4855-8cac-140731f8f8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:32.045681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed95317-4361-4855-8cac-140731f8f8a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:32.045997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed95317-4361-4855-8cac-140731f8f8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:32.047445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed95317-4361-4855-8cac-140731f8f8a5 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:32.056042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 627/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:32.062548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cdde8-e882-422d-ab3c-1c8723801fde None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:32.166305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cdde8-e882-422d-ab3c-1c8723801fde None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:32.200744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312837-7b92-4f90-a926-a740d899d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:32.201662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312837-7b92-4f90-a926-a740d899d4ba None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:32.207953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312837-7b92-4f90-a926-a740d899d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:32.207953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312837-7b92-4f90-a926-a740d899d4ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:32.214087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d312837-7b92-4f90-a926-a740d899d4ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:32.215875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d312837-7b92-4f90-a926-a740d899d4ba None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-1d312837-7b92-4f90-a926-a740d899d4ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:32.235462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:32.236792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:32.244428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:32.244428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:32.244428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:32.244428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:32.244428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 638/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:32.244795 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed95317-4361-4855-8cac-140731f8f8a5 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:32.351942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed95317-4361-4855-8cac-140731f8f8a5 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:32.401267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873ca8-9d6e-4fc1-84b0-90f1c4d52543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:32.402098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873ca8-9d6e-4fc1-84b0-90f1c4d52543 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:32.402386 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873ca8-9d6e-4fc1-84b0-90f1c4d52543 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:32.402665 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873ca8-9d6e-4fc1-84b0-90f1c4d52543 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:32.403418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873ca8-9d6e-4fc1-84b0-90f1c4d52543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:32.403705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873ca8-9d6e-4fc1-84b0-90f1c4d52543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:32.405122 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873ca8-9d6e-4fc1-84b0-90f1c4d52543 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:32.417965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 628/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:32.424946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312837-7b92-4f90-a926-a740d899d4ba None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:32.530202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312837-7b92-4f90-a926-a740d899d4ba None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:32.565517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdb320-7cec-485f-b3a3-884bb7b34277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:32.566367 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdb320-7cec-485f-b3a3-884bb7b34277 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:32.566650 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdb320-7cec-485f-b3a3-884bb7b34277 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:32.566926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdb320-7cec-485f-b3a3-884bb7b34277 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:32.574854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdb320-7cec-485f-b3a3-884bb7b34277 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:32.576314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdb320-7cec-485f-b3a3-884bb7b34277 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-89bdb320-7cec-485f-b3a3-884bb7b34277 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:21:32.592200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:32.594002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:32.595044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 639/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:32.600440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873ca8-9d6e-4fc1-84b0-90f1c4d52543 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:32.717003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873ca8-9d6e-4fc1-84b0-90f1c4d52543 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:32.755669 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a09bb-467e-43aa-a6b8-b40af9e6b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:32.756355 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a09bb-467e-43aa-a6b8-b40af9e6b613 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:32.756637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a09bb-467e-43aa-a6b8-b40af9e6b613 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:32.756911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a09bb-467e-43aa-a6b8-b40af9e6b613 None admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:32.757783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a09bb-467e-43aa-a6b8-b40af9e6b613 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:32.758091 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a09bb-467e-43aa-a6b8-b40af9e6b613 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:32.759504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a09bb-467e-43aa-a6b8-b40af9e6b613 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:32.778533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 629/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 12 20:21:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:32.784803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdb320-7cec-485f-b3a3-884bb7b34277 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:32.888774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdb320-7cec-485f-b3a3-884bb7b34277 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:32.927201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b55c7-bb66-471d-afb6-4bcb791476ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:32.928014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b55c7-bb66-471d-afb6-4bcb791476ae None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:32.928301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b55c7-bb66-471d-afb6-4bcb791476ae None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:32.928580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b55c7-bb66-471d-afb6-4bcb791476ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:32.939944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b55c7-bb66-471d-afb6-4bcb791476ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:32.941472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b55c7-bb66-471d-afb6-4bcb791476ae None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-a01b55c7-bb66-471d-afb6-4bcb791476ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:32.961190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:32.962412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:32.963528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:32.963528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:32.963528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:32.963528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:32.963528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 640/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:32.969768 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a09bb-467e-43aa-a6b8-b40af9e6b613 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:33.080119 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a09bb-467e-43aa-a6b8-b40af9e6b613 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:33.119270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df451f-3df7-46d4-9ee0-89d7b9a8fdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:33.119948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df451f-3df7-46d4-9ee0-89d7b9a8fdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:33.120237 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df451f-3df7-46d4-9ee0-89d7b9a8fdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:33.120523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df451f-3df7-46d4-9ee0-89d7b9a8fdc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:33.121258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df451f-3df7-46d4-9ee0-89d7b9a8fdc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:33.121599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df451f-3df7-46d4-9ee0-89d7b9a8fdc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:33.123225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df451f-3df7-46d4-9ee0-89d7b9a8fdc3 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:33.134907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 630/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:21:33.141113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b55c7-bb66-471d-afb6-4bcb791476ae None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:33.244858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b55c7-bb66-471d-afb6-4bcb791476ae None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:33.281886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc0c3c-0f34-4931-960c-21aa623e5850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:33.282922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0c3c-0f34-4931-960c-21aa623e5850 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:33.283147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0c3c-0f34-4931-960c-21aa623e5850 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:33.283437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0c3c-0f34-4931-960c-21aa623e5850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:33.290813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc0c3c-0f34-4931-960c-21aa623e5850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:33.292281 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc0c3c-0f34-4931-960c-21aa623e5850 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-b1cc0c3c-0f34-4931-960c-21aa623e5850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:21:33.306495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:33.307550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:33.308686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:21:33.308686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:21:33.308686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:21:33.308686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:21:33.308686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:21:33.308686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:21:33.308686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:33.308686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:33.308686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 641/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:21:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:33.314318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df451f-3df7-46d4-9ee0-89d7b9a8fdc3 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:33.431101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df451f-3df7-46d4-9ee0-89d7b9a8fdc3 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:33.467686 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7963dc-cde0-47bc-bbdf-de8d38bfea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:33.468704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7963dc-cde0-47bc-bbdf-de8d38bfea90 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:33.468987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7963dc-cde0-47bc-bbdf-de8d38bfea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:33.469263 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7963dc-cde0-47bc-bbdf-de8d38bfea90 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:33.479716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7963dc-cde0-47bc-bbdf-de8d38bfea90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:33.479716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7963dc-cde0-47bc-bbdf-de8d38bfea90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:33.479716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7963dc-cde0-47bc-bbdf-de8d38bfea90 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:33.484700 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 631/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:21:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:33.490642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc0c3c-0f34-4931-960c-21aa623e5850 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:33.592679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc0c3c-0f34-4931-960c-21aa623e5850 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:33.629602 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edcdcd-4e35-4397-b352-c338e127fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:33.630514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edcdcd-4e35-4397-b352-c338e127fba7 None admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:33.630802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edcdcd-4e35-4397-b352-c338e127fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:33.631083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edcdcd-4e35-4397-b352-c338e127fba7 None admin] PATH_INFO: `/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/65431a33849249ed8686d03b0c2e3a5b/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:33.633141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edcdcd-4e35-4397-b352-c338e127fba7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c07a45094a87bfacd9899fcf3dd7, user_id=65431a33849249ed8686d03b0c2e3a5b, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:33.634676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edcdcd-4e35-4397-b352-c338e127fba7 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:33.758868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 642/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Thu May 12 20:21:33 2022] PUT /identity/v3/projects/3888c07a45094a87bfacd9899fcf3dd7/users/65431a33849249ed8686d03b0c2e3a5b/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:21:36.018107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1f828-db23-4113-80bc-97bb5e0aa5ba None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:36.018971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1f828-db23-4113-80bc-97bb5e0aa5ba None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:36.019127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1f828-db23-4113-80bc-97bb5e0aa5ba None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:36.020581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 632/1274] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:21:36.026487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249189-73c0-424b-87bc-d37d62e4abed None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:36.026967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249189-73c0-424b-87bc-d37d62e4abed None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:36.027057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249189-73c0-424b-87bc-d37d62e4abed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:36.044539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d0249189-73c0-424b-87bc-d37d62e4abed None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:36.046278 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d0249189-73c0-424b-87bc-d37d62e4abed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:36.115199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 643/1275] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:21:36.140442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1f828-db23-4113-80bc-97bb5e0aa5ba None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:36.238515 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1f828-db23-4113-80bc-97bb5e0aa5ba None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:36.271879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a892d8-5979-4848-baf5-7817ab8d8277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:36.272683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a892d8-5979-4848-baf5-7817ab8d8277 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:36.272969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a892d8-5979-4848-baf5-7817ab8d8277 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:36.273248 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a892d8-5979-4848-baf5-7817ab8d8277 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:36.283556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a892d8-5979-4848-baf5-7817ab8d8277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-96a892d8-5979-4848-baf5-7817ab8d8277 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 20:21:36.291157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:36.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:36.293319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 633/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Thu May 12 20:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:36.299284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249189-73c0-424b-87bc-d37d62e4abed None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:36.396998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249189-73c0-424b-87bc-d37d62e4abed None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:36.431121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2dfce-80a6-421e-99f7-670eab3ef01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:36.431793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2dfce-80a6-421e-99f7-670eab3ef01d None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:36.432083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2dfce-80a6-421e-99f7-670eab3ef01d None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:36.432364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2dfce-80a6-421e-99f7-670eab3ef01d None admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:36.433107 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2dfce-80a6-421e-99f7-670eab3ef01d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:36.433448 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2dfce-80a6-421e-99f7-670eab3ef01d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:36.434810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2dfce-80a6-421e-99f7-670eab3ef01d None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:36.442664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 644/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Thu May 12 20:21:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:21:36.448362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a892d8-5979-4848-baf5-7817ab8d8277 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:36.552956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a892d8-5979-4848-baf5-7817ab8d8277 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:36.586652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe2b92-1bee-458b-a192-2dc4b1b6655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:36.587452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe2b92-1bee-458b-a192-2dc4b1b6655d None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:36.587736 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe2b92-1bee-458b-a192-2dc4b1b6655d None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:36.588013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe2b92-1bee-458b-a192-2dc4b1b6655d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:36.599492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe2b92-1bee-458b-a192-2dc4b1b6655d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:36.601080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe2b92-1bee-458b-a192-2dc4b1b6655d None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-85fe2b92-1bee-458b-a192-2dc4b1b6655d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:36.619043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:36.620152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:36.621114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:36.621114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:36.621114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:36.621114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:36.621114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 634/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:36.626547 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2dfce-80a6-421e-99f7-670eab3ef01d None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:36.731010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2dfce-80a6-421e-99f7-670eab3ef01d None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:36.764811 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd805cf3-8b0c-4f5d-a4bb-373f794a5e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:36.765602 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd805cf3-8b0c-4f5d-a4bb-373f794a5e5a None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:36.765889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd805cf3-8b0c-4f5d-a4bb-373f794a5e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:36.766387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd805cf3-8b0c-4f5d-a4bb-373f794a5e5a None admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:36.766871 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd805cf3-8b0c-4f5d-a4bb-373f794a5e5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:36.767180 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd805cf3-8b0c-4f5d-a4bb-373f794a5e5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:36.768537 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd805cf3-8b0c-4f5d-a4bb-373f794a5e5a None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:36.785207 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 645/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:36.790902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe2b92-1bee-458b-a192-2dc4b1b6655d None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:36.892442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe2b92-1bee-458b-a192-2dc4b1b6655d None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:36.926516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db99410-3360-4448-a71f-66933e837095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:36.927326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db99410-3360-4448-a71f-66933e837095 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:36.927610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db99410-3360-4448-a71f-66933e837095 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:36.927892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db99410-3360-4448-a71f-66933e837095 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:36.935773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db99410-3360-4448-a71f-66933e837095 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:36.937290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db99410-3360-4448-a71f-66933e837095 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-3db99410-3360-4448-a71f-66933e837095 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 20:21:36.951493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:36.953658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:36.954962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 635/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:36.959141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd805cf3-8b0c-4f5d-a4bb-373f794a5e5a None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:37.063245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd805cf3-8b0c-4f5d-a4bb-373f794a5e5a None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:37.098979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5678f-f4ee-4af8-898c-67d36dfa753f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:37.107156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5678f-f4ee-4af8-898c-67d36dfa753f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:37.107156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5678f-f4ee-4af8-898c-67d36dfa753f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:37.107156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5678f-f4ee-4af8-898c-67d36dfa753f None admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:37.107156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5678f-f4ee-4af8-898c-67d36dfa753f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:37.107156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5678f-f4ee-4af8-898c-67d36dfa753f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:37.107156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5678f-f4ee-4af8-898c-67d36dfa753f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:37.119878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 646/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Thu May 12 20:21:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:37.126671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db99410-3360-4448-a71f-66933e837095 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:37.225002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db99410-3360-4448-a71f-66933e837095 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:37.259392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a7a90-9b35-49ae-84b4-0b888fdd3594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:37.260047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7a90-9b35-49ae-84b4-0b888fdd3594 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:37.260332 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7a90-9b35-49ae-84b4-0b888fdd3594 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:37.260609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7a90-9b35-49ae-84b4-0b888fdd3594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:37.330111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a7a90-9b35-49ae-84b4-0b888fdd3594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:37.331492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a7a90-9b35-49ae-84b4-0b888fdd3594 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:37.430703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 636/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Thu May 12 20:21:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 20:21:37.437985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5678f-f4ee-4af8-898c-67d36dfa753f None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:37.536332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5678f-f4ee-4af8-898c-67d36dfa753f None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:37.577195 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a699607-ab65-46a3-bed0-71717b851f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:37.578464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a699607-ab65-46a3-bed0-71717b851f37 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:37.578899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a699607-ab65-46a3-bed0-71717b851f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:37.579180 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a699607-ab65-46a3-bed0-71717b851f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:37.590246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a699607-ab65-46a3-bed0-71717b851f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:37.591697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a699607-ab65-46a3-bed0-71717b851f37 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-6a699607-ab65-46a3-bed0-71717b851f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 20:21:37.610849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:37.612113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:37.615257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 20:21:37.615257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 20:21:37.615257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 20:21:37.615257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:37.615257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 647/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:37.618466 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a7a90-9b35-49ae-84b4-0b888fdd3594 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:37.721513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a7a90-9b35-49ae-84b4-0b888fdd3594 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:37.756484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638d7e2-4431-42ca-b8ce-4915f04af7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:37.757149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638d7e2-4431-42ca-b8ce-4915f04af7cb None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:37.757529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638d7e2-4431-42ca-b8ce-4915f04af7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:37.757809 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638d7e2-4431-42ca-b8ce-4915f04af7cb None admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:37.758534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638d7e2-4431-42ca-b8ce-4915f04af7cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:37.758841 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638d7e2-4431-42ca-b8ce-4915f04af7cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:37.760195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638d7e2-4431-42ca-b8ce-4915f04af7cb None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:37.771197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 637/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Thu May 12 20:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:37.777133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a699607-ab65-46a3-bed0-71717b851f37 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:37.878999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a699607-ab65-46a3-bed0-71717b851f37 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:37.917987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93877e-5c8e-4ebf-80a5-84396b4bb00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:37.917987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93877e-5c8e-4ebf-80a5-84396b4bb00c None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:37.917987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93877e-5c8e-4ebf-80a5-84396b4bb00c None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:37.917987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93877e-5c8e-4ebf-80a5-84396b4bb00c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:37.927582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93877e-5c8e-4ebf-80a5-84396b4bb00c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:37.929215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93877e-5c8e-4ebf-80a5-84396b4bb00c None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-0a93877e-5c8e-4ebf-80a5-84396b4bb00c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 20:21:37.944431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:37.945579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:37.946522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:21:37.946522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:21:37.946522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:21:37.946522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:21:37.946522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:21:37.946522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:21:37.946522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 20:21:37.946522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:21:37.946522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 648/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Thu May 12 20:21:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:37.951617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638d7e2-4431-42ca-b8ce-4915f04af7cb None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:38.052758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638d7e2-4431-42ca-b8ce-4915f04af7cb None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:38.086175 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2555-2c5e-479d-b09d-0597af2df6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:38.086839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2555-2c5e-479d-b09d-0597af2df6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:38.087124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2555-2c5e-479d-b09d-0597af2df6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:38.087400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2555-2c5e-479d-b09d-0597af2df6c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:38.088187 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba2555-2c5e-479d-b09d-0597af2df6c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:38.088494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba2555-2c5e-479d-b09d-0597af2df6c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:38.089947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba2555-2c5e-479d-b09d-0597af2df6c9 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:38.103005 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 638/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Thu May 12 20:21:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:38.109172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93877e-5c8e-4ebf-80a5-84396b4bb00c None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:38.214294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93877e-5c8e-4ebf-80a5-84396b4bb00c None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:38.249561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c5486-d653-4b51-a2ca-9f7eb7aa8ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:38.250284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c5486-d653-4b51-a2ca-9f7eb7aa8ade None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:38.250568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c5486-d653-4b51-a2ca-9f7eb7aa8ade None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:38.250916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c5486-d653-4b51-a2ca-9f7eb7aa8ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:38.251748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c5486-d653-4b51-a2ca-9f7eb7aa8ade None admin] RBAC: Adding query filter params (role.id=4ae0665802b946be870ab06274297a1d, scope.project.id=3888c07a45094a87bfacd9899fcf3dd7, user.id=65431a33849249ed8686d03b0c2e3a5b) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:38.252147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c5486-d653-4b51-a2ca-9f7eb7aa8ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:38.258130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c5486-d653-4b51-a2ca-9f7eb7aa8ade None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:38.260655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 649/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Thu May 12 20:21:38 2022] GET /identity/v3/role_assignments?user.id=65431a33849249ed8686d03b0c2e3a5b&scope.project.id=3888c07a45094a87bfacd9899fcf3dd7&role.id=4ae0665802b946be870ab06274297a1d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:40.522670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604563c-13a3-4375-994a-c2bca2d55bb5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:40.523236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604563c-13a3-4375-994a-c2bca2d55bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:40.523236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604563c-13a3-4375-994a-c2bca2d55bb5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:40.524659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 639/1288] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:21:40.530582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722ca6-2d85-4b6c-9c3c-861428042dfa None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:40.531085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722ca6-2d85-4b6c-9c3c-861428042dfa None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:40.531194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87722ca6-2d85-4b6c-9c3c-861428042dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:40.547753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-87722ca6-2d85-4b6c-9c3c-861428042dfa None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:40.548944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-87722ca6-2d85-4b6c-9c3c-861428042dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:40.616927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 650/1289] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:21:40.638975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604563c-13a3-4375-994a-c2bca2d55bb5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:40.742864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604563c-13a3-4375-994a-c2bca2d55bb5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:40.776969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0656d-ce54-48ac-82ec-35853ae99940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:40.777708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0656d-ce54-48ac-82ec-35853ae99940 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:40.777993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0656d-ce54-48ac-82ec-35853ae99940 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:40.778263 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0656d-ce54-48ac-82ec-35853ae99940 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:40.778914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0656d-ce54-48ac-82ec-35853ae99940 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:40.780507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0656d-ce54-48ac-82ec-35853ae99940 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-e4b0656d-ce54-48ac-82ec-35853ae99940 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:40.792375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:40.793677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:40.794967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 640/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 12 20:21:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:40.800283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87722ca6-2d85-4b6c-9c3c-861428042dfa None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:40.897609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87722ca6-2d85-4b6c-9c3c-861428042dfa None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:40.931933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9237657-dfc6-4734-90f0-0ea7a0affeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:40.932606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9237657-dfc6-4734-90f0-0ea7a0affeda None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:40.932893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9237657-dfc6-4734-90f0-0ea7a0affeda None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:40.933172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9237657-dfc6-4734-90f0-0ea7a0affeda None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:40.933928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9237657-dfc6-4734-90f0-0ea7a0affeda None admin] RBAC: Adding query filter params (name=placement) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:40.934239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9237657-dfc6-4734-90f0-0ea7a0affeda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:40.935596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9237657-dfc6-4734-90f0-0ea7a0affeda None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:40.940687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 651/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Thu May 12 20:21:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:40.946331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0656d-ce54-48ac-82ec-35853ae99940 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:41.044548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0656d-ce54-48ac-82ec-35853ae99940 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:41.079803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9ff12-9385-40d3-b28c-b61186e7e3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:41.080472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9ff12-9385-40d3-b28c-b61186e7e3ce None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:41.080753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9ff12-9385-40d3-b28c-b61186e7e3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:41.081028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9ff12-9385-40d3-b28c-b61186e7e3ce None admin] PATH_INFO: `/v3/services` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:41.081773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9ff12-9385-40d3-b28c-b61186e7e3ce None admin] RBAC: Adding query filter params (type=placement) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:41.082077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9ff12-9385-40d3-b28c-b61186e7e3ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:41.083443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9ff12-9385-40d3-b28c-b61186e7e3ce None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:41.090272 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 641/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Thu May 12 20:21:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:43.349776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253427-7b2f-42df-a8c4-c7f2cffd0505 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:43.350313 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253427-7b2f-42df-a8c4-c7f2cffd0505 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:43.350408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253427-7b2f-42df-a8c4-c7f2cffd0505 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:43.351750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 652/1293] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:21:43.357148 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27c36a-0f76-41a4-ac8b-3b0bdc3adbe4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:43.357611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27c36a-0f76-41a4-ac8b-3b0bdc3adbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:43.357733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27c36a-0f76-41a4-ac8b-3b0bdc3adbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:43.380637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0f27c36a-0f76-41a4-ac8b-3b0bdc3adbe4 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:43.381873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0f27c36a-0f76-41a4-ac8b-3b0bdc3adbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:43.449107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 642/1294] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:21:43.472660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83253427-7b2f-42df-a8c4-c7f2cffd0505 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:43.572796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83253427-7b2f-42df-a8c4-c7f2cffd0505 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:43.607459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb183ea-a6d6-40fd-8f41-5fe8b77762aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:43.608594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb183ea-a6d6-40fd-8f41-5fe8b77762aa None admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:43.608886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb183ea-a6d6-40fd-8f41-5fe8b77762aa None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:43.609173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb183ea-a6d6-40fd-8f41-5fe8b77762aa None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:43.609994 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb183ea-a6d6-40fd-8f41-5fe8b77762aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:43.611355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb183ea-a6d6-40fd-8f41-5fe8b77762aa None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:43.754213 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 653/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Thu May 12 20:21:43 2022] POST /identity/v3/services => generated 246 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:21:46.032110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11e03-f649-406a-8be5-e30d59a7626f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:46.032647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11e03-f649-406a-8be5-e30d59a7626f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:46.032647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11e03-f649-406a-8be5-e30d59a7626f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:46.034046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 643/1296] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:21:46.039532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9d3e-bf3a-43e7-9e57-fd5900f333b5 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:46.040013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9d3e-bf3a-43e7-9e57-fd5900f333b5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:46.040116 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9d3e-bf3a-43e7-9e57-fd5900f333b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:46.058326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-4dcc9d3e-bf3a-43e7-9e57-fd5900f333b5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:46.059515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4dcc9d3e-bf3a-43e7-9e57-fd5900f333b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:46.134966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 654/1297] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:21:46.158126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c11e03-f649-406a-8be5-e30d59a7626f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:46.258991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c11e03-f649-406a-8be5-e30d59a7626f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:46.292761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb8284-f1d0-4a01-ad7d-2534f8bd9b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:46.293589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb8284-f1d0-4a01-ad7d-2534f8bd9b37 None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:46.293873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb8284-f1d0-4a01-ad7d-2534f8bd9b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:46.294151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb8284-f1d0-4a01-ad7d-2534f8bd9b37 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:46.294807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb8284-f1d0-4a01-ad7d-2534f8bd9b37 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:46.296891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb8284-f1d0-4a01-ad7d-2534f8bd9b37 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-a4fb8284-f1d0-4a01-ad7d-2534f8bd9b37 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:46.308839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:46.310216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:46.311469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 644/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 12 20:21:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:46.316242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc9d3e-bf3a-43e7-9e57-fd5900f333b5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:46.418263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc9d3e-bf3a-43e7-9e57-fd5900f333b5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:46.446868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355cc04-6d7d-483f-8775-ab73dd6279f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:46.448247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355cc04-6d7d-483f-8775-ab73dd6279f1 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:46.448247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355cc04-6d7d-483f-8775-ab73dd6279f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:46.448247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355cc04-6d7d-483f-8775-ab73dd6279f1 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:46.448789 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355cc04-6d7d-483f-8775-ab73dd6279f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:46.449094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355cc04-6d7d-483f-8775-ab73dd6279f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:46.450512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355cc04-6d7d-483f-8775-ab73dd6279f1 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:46.456503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 655/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Thu May 12 20:21:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:46.462669 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb8284-f1d0-4a01-ad7d-2534f8bd9b37 None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:46.562504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb8284-f1d0-4a01-ad7d-2534f8bd9b37 None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:46.596573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbc3b1-4f34-4d91-97ef-df140cf53b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:46.597237 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbc3b1-4f34-4d91-97ef-df140cf53b8e None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:46.597558 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbc3b1-4f34-4d91-97ef-df140cf53b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:46.597838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbc3b1-4f34-4d91-97ef-df140cf53b8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:46.598630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbc3b1-4f34-4d91-97ef-df140cf53b8e None admin] RBAC: Adding query filter params (interface=public, service_id=ca0cc1277578498bbf5080b716daa580, region_id=RegionOne) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:46.598946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbc3b1-4f34-4d91-97ef-df140cf53b8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:46.600310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbc3b1-4f34-4d91-97ef-df140cf53b8e None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:46.605449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 645/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Thu May 12 20:21:46 2022] GET /identity/v3/endpoints?service_id=ca0cc1277578498bbf5080b716daa580&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:46.611685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355cc04-6d7d-483f-8775-ab73dd6279f1 None admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:46.709392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355cc04-6d7d-483f-8775-ab73dd6279f1 None admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:46.743467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef3d10-b9a1-442a-8f8b-5161fb1bb93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:46.744238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3d10-b9a1-442a-8f8b-5161fb1bb93f None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:46.744590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3d10-b9a1-442a-8f8b-5161fb1bb93f None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:46.744928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef3d10-b9a1-442a-8f8b-5161fb1bb93f None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:46.745786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef3d10-b9a1-442a-8f8b-5161fb1bb93f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:46.757359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef3d10-b9a1-442a-8f8b-5161fb1bb93f None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:46.757359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 656/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Thu May 12 20:21:46 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:21:49.064405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697531-7a55-4c8b-b343-c62232ef3c14 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:49.064974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697531-7a55-4c8b-b343-c62232ef3c14 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:49.064974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697531-7a55-4c8b-b343-c62232ef3c14 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:49.066357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 646/1302] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:21:49.072711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32c97b-ea7d-42c6-99be-f114224c7447 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:49.073231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32c97b-ea7d-42c6-99be-f114224c7447 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:49.073375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32c97b-ea7d-42c6-99be-f114224c7447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:49.090686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-9c32c97b-ea7d-42c6-99be-f114224c7447 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:21:49.091933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9c32c97b-ea7d-42c6-99be-f114224c7447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:21:49.160808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 657/1303] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:21:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 20:21:49.183269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b697531-7a55-4c8b-b343-c62232ef3c14 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:49.291978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b697531-7a55-4c8b-b343-c62232ef3c14 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:49.330155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75346449-b8ee-409c-961f-99363c5b918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:49.331393 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75346449-b8ee-409c-961f-99363c5b918c None admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:49.331804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75346449-b8ee-409c-961f-99363c5b918c None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:49.332194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75346449-b8ee-409c-961f-99363c5b918c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:49.333213 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75346449-b8ee-409c-961f-99363c5b918c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:49.335429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75346449-b8ee-409c-961f-99363c5b918c None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application [None req-75346449-b8ee-409c-961f-99363c5b918c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:21:49.349084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:21:49.354775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application with Lock( May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self._enter() May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application return self.creator() May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application created_value = creator( May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: ERROR keystone.server.flask.application May 12 20:21:49.355892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 647/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Thu May 12 20:21:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 20:21:49.356881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32c97b-ea7d-42c6-99be-f114224c7447 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:49.457258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32c97b-ea7d-42c6-99be-f114224c7447 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:49.492059 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d96af-5a25-4aa1-be99-a22d673bac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:49.492747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d96af-5a25-4aa1-be99-a22d673bac06 None admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:49.493034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d96af-5a25-4aa1-be99-a22d673bac06 None admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:49.493344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d96af-5a25-4aa1-be99-a22d673bac06 None admin] PATH_INFO: `/v3/services` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:49.494061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d96af-5a25-4aa1-be99-a22d673bac06 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:21:49.494366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d96af-5a25-4aa1-be99-a22d673bac06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:49.495806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d96af-5a25-4aa1-be99-a22d673bac06 None admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:49.502804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 658/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Thu May 12 20:21:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:21:49.508800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75346449-b8ee-409c-961f-99363c5b918c None admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:21:49.607251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75346449-b8ee-409c-961f-99363c5b918c None admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:21:49.653412 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1094996-4f75-4f23-8974-ba38f8a9afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:21:49.654079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1094996-4f75-4f23-8974-ba38f8a9afc2 None admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:21:49.654361 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1094996-4f75-4f23-8974-ba38f8a9afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:21:49.654883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1094996-4f75-4f23-8974-ba38f8a9afc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:21:49.656123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1094996-4f75-4f23-8974-ba38f8a9afc2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:21:49.657639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1094996-4f75-4f23-8974-ba38f8a9afc2 None admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:21:49.758174 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 648/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Thu May 12 20:21:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:29:13.899352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d7055-91c8-4fc6-9dc8-2b0c9493dc00 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:13.899937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d7055-91c8-4fc6-9dc8-2b0c9493dc00 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:13.899937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d7055-91c8-4fc6-9dc8-2b0c9493dc00 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:13.901697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 659/1307] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:13.907202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143847f-0a1d-493a-be1b-5d47c3921a08 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:13.907650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143847f-0a1d-493a-be1b-5d47c3921a08 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:13.907772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143847f-0a1d-493a-be1b-5d47c3921a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:14.007398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f143847f-0a1d-493a-be1b-5d47c3921a08 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:14.008583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f143847f-0a1d-493a-be1b-5d47c3921a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:14.130351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 649/1308] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:14.180915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a59ce5-5a7a-4f02-b22c-744bf19ecd5a None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:14.181293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a59ce5-5a7a-4f02-b22c-744bf19ecd5a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:14.181660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a59ce5-5a7a-4f02-b22c-744bf19ecd5a None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:14.183096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 660/1309] 10.222.0.59 () {54 vars in 964 bytes} [Thu May 12 20:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:14.189224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deee4f-338f-4136-8f43-bfc6d367d3e1 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:14.189586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deee4f-338f-4136-8f43-bfc6d367d3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:14.190039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deee4f-338f-4136-8f43-bfc6d367d3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:14.269821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d0deee4f-338f-4136-8f43-bfc6d367d3e1 None None] MFA Rules not processed for user `4379d3e8b38645978efb08ea6f560fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:14.270979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d0deee4f-338f-4136-8f43-bfc6d367d3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:14.349307 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 650/1310] 10.222.0.59 () {58 vars in 1061 bytes} [Thu May 12 20:29:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:14.359058 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a59ce5-5a7a-4f02-b22c-744bf19ecd5a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:14.361141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e0a59ce5-5a7a-4f02-b22c-744bf19ecd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:14.469616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a59ce5-5a7a-4f02-b22c-744bf19ecd5a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:14.545823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4278556-14f8-4364-9251-a2f6c1d6760f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:14.546385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278556-14f8-4364-9251-a2f6c1d6760f service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:14.546669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278556-14f8-4364-9251-a2f6c1d6760f service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:14.546944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278556-14f8-4364-9251-a2f6c1d6760f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:14.548599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f4278556-14f8-4364-9251-a2f6c1d6760f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:14.662716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4278556-14f8-4364-9251-a2f6c1d6760f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:14.664235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4278556-14f8-4364-9251-a2f6c1d6760f service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:14.684676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 661/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:17.253326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff243dc-5b6f-4b81-bceb-909cdb9616a9 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:17.253846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff243dc-5b6f-4b81-bceb-909cdb9616a9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:17.253846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff243dc-5b6f-4b81-bceb-909cdb9616a9 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:17.255174 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 651/1312] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:17.261084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06da94-25de-4934-8662-6c8af633a2ad None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:17.261589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06da94-25de-4934-8662-6c8af633a2ad None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:17.261735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06da94-25de-4934-8662-6c8af633a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:17.331358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-ec06da94-25de-4934-8662-6c8af633a2ad None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:17.332560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ec06da94-25de-4934-8662-6c8af633a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:17.431589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 662/1313] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:17.469744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff243dc-5b6f-4b81-bceb-909cdb9616a9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:17.471290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0ff243dc-5b6f-4b81-bceb-909cdb9616a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:17.576800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff243dc-5b6f-4b81-bceb-909cdb9616a9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:17.665838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fd1cc-213f-4f62-acd9-c28383d4677f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:17.666501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fd1cc-213f-4f62-acd9-c28383d4677f service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:17.666785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fd1cc-213f-4f62-acd9-c28383d4677f service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:17.667060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fd1cc-213f-4f62-acd9-c28383d4677f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:17.668717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b55fd1cc-213f-4f62-acd9-c28383d4677f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:17.776896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fd1cc-213f-4f62-acd9-c28383d4677f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:17.778391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fd1cc-213f-4f62-acd9-c28383d4677f service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:17.797330 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 652/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:20.659273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016c6a-19e3-4e0e-a156-edcdfb7bc39f None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:20.659825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016c6a-19e3-4e0e-a156-edcdfb7bc39f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:20.659825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016c6a-19e3-4e0e-a156-edcdfb7bc39f None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:20.661215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 663/1315] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:20.667117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ee00f-0d34-47c7-bd4a-e2df40b4e267 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:20.667563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ee00f-0d34-47c7-bd4a-e2df40b4e267 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:20.667678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ee00f-0d34-47c7-bd4a-e2df40b4e267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:20.731585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b59ee00f-0d34-47c7-bd4a-e2df40b4e267 None None] MFA Rules not processed for user `7426c40478b347618984700782b5b8b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:20.732808 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b59ee00f-0d34-47c7-bd4a-e2df40b4e267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:20.833861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 653/1316] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:20.889458 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bca9c0-abdf-4125-a903-eb90614eb13f None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:20.889899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bca9c0-abdf-4125-a903-eb90614eb13f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:20.890250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bca9c0-abdf-4125-a903-eb90614eb13f None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:20.891627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 664/1317] 10.222.0.59 () {54 vars in 964 bytes} [Thu May 12 20:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:20.898557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2f188-9d07-4a0e-a628-6810062fc107 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:20.898847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2f188-9d07-4a0e-a628-6810062fc107 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:20.899126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2f188-9d07-4a0e-a628-6810062fc107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:20.973940 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-11c2f188-9d07-4a0e-a628-6810062fc107 None None] MFA Rules not processed for user `4379d3e8b38645978efb08ea6f560fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:20.975705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-11c2f188-9d07-4a0e-a628-6810062fc107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:21.050790 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 654/1318] 10.222.0.59 () {58 vars in 1061 bytes} [Thu May 12 20:29:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:21.060224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bca9c0-abdf-4125-a903-eb90614eb13f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:21.061859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f7bca9c0-abdf-4125-a903-eb90614eb13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:21.163783 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bca9c0-abdf-4125-a903-eb90614eb13f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:21.237133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95812d53-3bf2-491a-bb6a-e37c4e82ceae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:21.237841 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812d53-3bf2-491a-bb6a-e37c4e82ceae service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:21.238150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812d53-3bf2-491a-bb6a-e37c4e82ceae service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:21.238406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812d53-3bf2-491a-bb6a-e37c4e82ceae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:21.241018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-95812d53-3bf2-491a-bb6a-e37c4e82ceae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:21.349991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95812d53-3bf2-491a-bb6a-e37c4e82ceae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:21.351416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95812d53-3bf2-491a-bb6a-e37c4e82ceae service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:21.369760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 665/1319] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:24.844977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661ca6-b974-4cce-80f9-efc5277321f0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:24.845568 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661ca6-b974-4cce-80f9-efc5277321f0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:24.845661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661ca6-b974-4cce-80f9-efc5277321f0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:24.847007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 655/1320] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:24.853066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b137d1e-a4e9-4da1-b1ac-f575119c3b9b None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:24.853525 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b137d1e-a4e9-4da1-b1ac-f575119c3b9b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:24.853662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b137d1e-a4e9-4da1-b1ac-f575119c3b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:24.919136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-1b137d1e-a4e9-4da1-b1ac-f575119c3b9b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:24.920347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1b137d1e-a4e9-4da1-b1ac-f575119c3b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:25.019664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 666/1321] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:25.058863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661ca6-b974-4cce-80f9-efc5277321f0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:25.060397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-22661ca6-b974-4cce-80f9-efc5277321f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:25.165851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661ca6-b974-4cce-80f9-efc5277321f0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:25.242051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5e5f1-d8c5-4997-85bf-34a0bebccc75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:25.242699 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5e5f1-d8c5-4997-85bf-34a0bebccc75 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:25.242981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5e5f1-d8c5-4997-85bf-34a0bebccc75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:25.243261 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5e5f1-d8c5-4997-85bf-34a0bebccc75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:25.244884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-69f5e5f1-d8c5-4997-85bf-34a0bebccc75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:25.351501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5e5f1-d8c5-4997-85bf-34a0bebccc75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:25.352923 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5e5f1-d8c5-4997-85bf-34a0bebccc75 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:25.371271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 656/1322] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:28.849023 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a78ff1-0a81-4731-9374-cec0e2b431ac None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:28.849725 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a78ff1-0a81-4731-9374-cec0e2b431ac None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:28.849725 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a78ff1-0a81-4731-9374-cec0e2b431ac None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:28.851695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 667/1323] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:28.856806 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ef9c-00f3-4b01-9c72-4ce9f0d92847 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:28.857317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ef9c-00f3-4b01-9c72-4ce9f0d92847 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:28.857535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ef9c-00f3-4b01-9c72-4ce9f0d92847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:28.925073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e504ef9c-00f3-4b01-9c72-4ce9f0d92847 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:28.926333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e504ef9c-00f3-4b01-9c72-4ce9f0d92847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:29.028402 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 657/1324] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:29.064976 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a78ff1-0a81-4731-9374-cec0e2b431ac None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:29.067815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-36a78ff1-0a81-4731-9374-cec0e2b431ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:29.172720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a78ff1-0a81-4731-9374-cec0e2b431ac None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:29.247713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c147fb5-ada7-470e-8bd7-1c04e40fd570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:29.248371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c147fb5-ada7-470e-8bd7-1c04e40fd570 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:29.248654 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c147fb5-ada7-470e-8bd7-1c04e40fd570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:29.248931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c147fb5-ada7-470e-8bd7-1c04e40fd570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:29.250899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1c147fb5-ada7-470e-8bd7-1c04e40fd570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:29.362101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c147fb5-ada7-470e-8bd7-1c04e40fd570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:29.363558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c147fb5-ada7-470e-8bd7-1c04e40fd570 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:29.383127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 668/1325] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:31.695972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8c732-5f78-4477-b0c9-e5483e6f4236 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:31.696971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8c732-5f78-4477-b0c9-e5483e6f4236 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:31.696971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8c732-5f78-4477-b0c9-e5483e6f4236 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:31.698583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 658/1326] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:31.704380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb67c-7c84-400b-9507-80f5f707f1a9 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:31.704850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb67c-7c84-400b-9507-80f5f707f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:31.704958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb67c-7c84-400b-9507-80f5f707f1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:31.772083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-bb0eb67c-7c84-400b-9507-80f5f707f1a9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:31.773325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bb0eb67c-7c84-400b-9507-80f5f707f1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:31.876745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 669/1327] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:31.913433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8c732-5f78-4477-b0c9-e5483e6f4236 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:31.915025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-03d8c732-5f78-4477-b0c9-e5483e6f4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:32.018706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8c732-5f78-4477-b0c9-e5483e6f4236 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:32.090232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12773174-ce9e-4a04-9e3b-072e83c11598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:32.090897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12773174-ce9e-4a04-9e3b-072e83c11598 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:32.091176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12773174-ce9e-4a04-9e3b-072e83c11598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:32.091453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12773174-ce9e-4a04-9e3b-072e83c11598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:32.093085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-12773174-ce9e-4a04-9e3b-072e83c11598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:32.204323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12773174-ce9e-4a04-9e3b-072e83c11598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:32.205797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12773174-ce9e-4a04-9e3b-072e83c11598 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:32.226591 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 659/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:34.575734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e20b-3087-4d4e-92b9-6cac5fabf68c None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:34.576313 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e20b-3087-4d4e-92b9-6cac5fabf68c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:34.576313 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e20b-3087-4d4e-92b9-6cac5fabf68c None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:34.577742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 670/1329] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:34.585116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cafb8-b358-4662-b177-90909bc4ed13 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:34.585981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cafb8-b358-4662-b177-90909bc4ed13 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:34.585981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cafb8-b358-4662-b177-90909bc4ed13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:34.679134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-023cafb8-b358-4662-b177-90909bc4ed13 None None] MFA Rules not processed for user `7426c40478b347618984700782b5b8b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:34.680358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-023cafb8-b358-4662-b177-90909bc4ed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:34.784693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 660/1330] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:29:34.823072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610e20b-3087-4d4e-92b9-6cac5fabf68c None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:34.824644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3610e20b-3087-4d4e-92b9-6cac5fabf68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:34.965818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610e20b-3087-4d4e-92b9-6cac5fabf68c None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:35.042285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5429-ec5e-4905-88ad-1a5c3f5aa50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:35.042942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5429-ec5e-4905-88ad-1a5c3f5aa50f service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:35.043277 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5429-ec5e-4905-88ad-1a5c3f5aa50f service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:35.043557 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5429-ec5e-4905-88ad-1a5c3f5aa50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:35.045204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ebcc5429-ec5e-4905-88ad-1a5c3f5aa50f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:35.155759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc5429-ec5e-4905-88ad-1a5c3f5aa50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:35.157197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc5429-ec5e-4905-88ad-1a5c3f5aa50f service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:35.176446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 671/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:37.959364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e308-25bc-40ac-b986-243f2d8fbde0 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:37.959863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e308-25bc-40ac-b986-243f2d8fbde0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:37.959863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e308-25bc-40ac-b986-243f2d8fbde0 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:37.961211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 661/1332] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:37.966637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc1a7f-c710-4769-a9b7-a325bda48565 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:37.967053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc1a7f-c710-4769-a9b7-a325bda48565 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:37.967192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc1a7f-c710-4769-a9b7-a325bda48565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:38.035208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-47cc1a7f-c710-4769-a9b7-a325bda48565 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:38.037024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-47cc1a7f-c710-4769-a9b7-a325bda48565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:38.130918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 672/1333] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:38.167181 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e308-25bc-40ac-b986-243f2d8fbde0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:38.168709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0076e308-25bc-40ac-b986-243f2d8fbde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:38.288769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e308-25bc-40ac-b986-243f2d8fbde0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:38.370374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31d6ca-ce68-4298-b827-f5dab4d14576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:38.371033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31d6ca-ce68-4298-b827-f5dab4d14576 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:38.371316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31d6ca-ce68-4298-b827-f5dab4d14576 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:38.371591 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31d6ca-ce68-4298-b827-f5dab4d14576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:38.373245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ef31d6ca-ce68-4298-b827-f5dab4d14576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:38.503650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31d6ca-ce68-4298-b827-f5dab4d14576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:38.505671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31d6ca-ce68-4298-b827-f5dab4d14576 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:38.524643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 662/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:40.870187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d802-38cc-44b0-a75c-7c8e9d860010 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:40.870997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d802-38cc-44b0-a75c-7c8e9d860010 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:40.871171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d802-38cc-44b0-a75c-7c8e9d860010 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:40.873394 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 673/1335] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:40.879306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75ec9d-239a-486c-8d0e-e0af86854806 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:40.879898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75ec9d-239a-486c-8d0e-e0af86854806 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:40.880279 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75ec9d-239a-486c-8d0e-e0af86854806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:40.947602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7d75ec9d-239a-486c-8d0e-e0af86854806 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:40.948819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7d75ec9d-239a-486c-8d0e-e0af86854806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:41.042816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 663/1336] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:41.083734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920d802-38cc-44b0-a75c-7c8e9d860010 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:41.085268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6920d802-38cc-44b0-a75c-7c8e9d860010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:41.189640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920d802-38cc-44b0-a75c-7c8e9d860010 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:41.263757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbf2b4-f75e-41be-abf7-7b50f9494bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:41.264417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbf2b4-f75e-41be-abf7-7b50f9494bbc service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:41.264705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbf2b4-f75e-41be-abf7-7b50f9494bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:41.264997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbf2b4-f75e-41be-abf7-7b50f9494bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:41.266691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-dcbbf2b4-f75e-41be-abf7-7b50f9494bbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:41.373208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbf2b4-f75e-41be-abf7-7b50f9494bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:41.374965 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbf2b4-f75e-41be-abf7-7b50f9494bbc service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:41.394099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 674/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:44.586567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0013-840e-415b-b207-ca9e63a7de21 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:44.587158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0013-840e-415b-b207-ca9e63a7de21 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:44.587158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0013-840e-415b-b207-ca9e63a7de21 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:44.588483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 664/1338] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:44.594037 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa219-ec09-4740-a4fc-e89bc3cd0504 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:44.594507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa219-ec09-4740-a4fc-e89bc3cd0504 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:44.594614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daa219-ec09-4740-a4fc-e89bc3cd0504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:44.668127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d3daa219-ec09-4740-a4fc-e89bc3cd0504 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:44.669370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d3daa219-ec09-4740-a4fc-e89bc3cd0504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:44.775023 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 675/1339] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:44.811642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0013-840e-415b-b207-ca9e63a7de21 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:44.813800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-12cf0013-840e-415b-b207-ca9e63a7de21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:44.919562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0013-840e-415b-b207-ca9e63a7de21 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:44.923268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bfe50-847b-43d9-b936-84ea6baf524e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:44.923936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bfe50-847b-43d9-b936-84ea6baf524e service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:44.924222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bfe50-847b-43d9-b936-84ea6baf524e service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:44.924503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bfe50-847b-43d9-b936-84ea6baf524e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:44.934491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bfe50-847b-43d9-b936-84ea6baf524e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:44.935932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bfe50-847b-43d9-b936-84ea6baf524e service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:44.946190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 665/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:49.835620 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d7e1a-64ea-40cb-ab6e-95d0db7d63b1 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:49.836191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d7e1a-64ea-40cb-ab6e-95d0db7d63b1 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:49.836191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d7e1a-64ea-40cb-ab6e-95d0db7d63b1 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:49.837574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 676/1341] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:29:49.843147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36538e-7f49-4047-83ef-038c9386762f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:49.843565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36538e-7f49-4047-83ef-038c9386762f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:49.843707 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36538e-7f49-4047-83ef-038c9386762f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:49.873491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fb36538e-7f49-4047-83ef-038c9386762f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:49.874937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fb36538e-7f49-4047-83ef-038c9386762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:49.951060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 666/1342] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:29:49.989410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d7e1a-64ea-40cb-ab6e-95d0db7d63b1 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:50.000141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d7e1a-64ea-40cb-ab6e-95d0db7d63b1 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:50.003662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ddb17-a1ac-495b-bd9b-2e432963797e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:50.004884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ddb17-a1ac-495b-bd9b-2e432963797e service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:50.005153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ddb17-a1ac-495b-bd9b-2e432963797e service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:50.005472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ddb17-a1ac-495b-bd9b-2e432963797e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:50.014251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ddb17-a1ac-495b-bd9b-2e432963797e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:50.015678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ddb17-a1ac-495b-bd9b-2e432963797e service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:50.025964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 677/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:53.268645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3f1b0-6680-4393-a2b3-91b88141869b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:53.269189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3f1b0-6680-4393-a2b3-91b88141869b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:53.269423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3f1b0-6680-4393-a2b3-91b88141869b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:53.270834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 667/1344] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:53.276165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43516d7b-d4b1-4531-962d-0979a2c26297 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:53.276594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43516d7b-d4b1-4531-962d-0979a2c26297 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:53.276872 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43516d7b-d4b1-4531-962d-0979a2c26297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:53.294096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-43516d7b-d4b1-4531-962d-0979a2c26297 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:53.295263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-43516d7b-d4b1-4531-962d-0979a2c26297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:53.303466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 678/1345] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:29:53.340176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3f1b0-6680-4393-a2b3-91b88141869b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:53.350760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3f1b0-6680-4393-a2b3-91b88141869b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:53.354247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dcc8a-3786-458f-a5db-235adaa16c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:53.354885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dcc8a-3786-458f-a5db-235adaa16c49 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:53.355176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dcc8a-3786-458f-a5db-235adaa16c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:53.355453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dcc8a-3786-458f-a5db-235adaa16c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:53.364663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dcc8a-3786-458f-a5db-235adaa16c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:53.366157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dcc8a-3786-458f-a5db-235adaa16c49 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:53.375611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 668/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:29:58.007646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c6e02-f40f-439b-ba6f-53b8469a5786 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:58.008184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c6e02-f40f-439b-ba6f-53b8469a5786 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:58.008184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c6e02-f40f-439b-ba6f-53b8469a5786 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:58.009603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 679/1347] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:29:58.014812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390683d-a4be-4011-b809-ee9d7da87415 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:58.015204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390683d-a4be-4011-b809-ee9d7da87415 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:58.015364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390683d-a4be-4011-b809-ee9d7da87415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:58.033822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4390683d-a4be-4011-b809-ee9d7da87415 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:29:58.036076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4390683d-a4be-4011-b809-ee9d7da87415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:29:58.043840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 669/1348] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:29:58.084713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c6e02-f40f-439b-ba6f-53b8469a5786 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:29:58.095335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c6e02-f40f-439b-ba6f-53b8469a5786 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:29:58.099817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73a94b-f4cf-4fa5-a948-5d1d233e6b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:29:58.100454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73a94b-f4cf-4fa5-a948-5d1d233e6b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:29:58.100738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73a94b-f4cf-4fa5-a948-5d1d233e6b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:29:58.101017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73a94b-f4cf-4fa5-a948-5d1d233e6b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:29:58.109887 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73a94b-f4cf-4fa5-a948-5d1d233e6b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:29:58.111333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73a94b-f4cf-4fa5-a948-5d1d233e6b1b service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:29:58.121472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 680/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:03.542134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebe843-dd89-4e8d-af13-683e55bc5e1e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:03.566389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebe843-dd89-4e8d-af13-683e55bc5e1e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:03.566389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebe843-dd89-4e8d-af13-683e55bc5e1e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:03.566389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 670/1350] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 12 20:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:03.566667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9d65-f928-4c09-a833-5bc1c0349bff None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:03.566667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9d65-f928-4c09-a833-5bc1c0349bff None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:03.566667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9d65-f928-4c09-a833-5bc1c0349bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:03.723096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f2da9d65-f928-4c09-a833-5bc1c0349bff None None] MFA Rules not processed for user `65431a33849249ed8686d03b0c2e3a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:03.727331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f2da9d65-f928-4c09-a833-5bc1c0349bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:03.877093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 681/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 12 20:30:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:30:08.382344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c16e6-f1b2-4ec1-bfdf-a8e2e447507d None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:08.382921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c16e6-f1b2-4ec1-bfdf-a8e2e447507d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:08.382921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c16e6-f1b2-4ec1-bfdf-a8e2e447507d None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:08.384216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 671/1352] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 12 20:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:08.389803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2c022-af61-4bc2-bda4-2ebd938ec8d3 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:08.390244 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2c022-af61-4bc2-bda4-2ebd938ec8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:08.390372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2c022-af61-4bc2-bda4-2ebd938ec8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:08.412231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-46e2c022-af61-4bc2-bda4-2ebd938ec8d3 None None] MFA Rules not processed for user `65431a33849249ed8686d03b0c2e3a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:08.413519 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-46e2c022-af61-4bc2-bda4-2ebd938ec8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:08.422439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 682/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 12 20:30:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:10.061979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4d89f-2da1-4428-9189-9bbbc19d6e60 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:10.062512 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4d89f-2da1-4428-9189-9bbbc19d6e60 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:10.062625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4d89f-2da1-4428-9189-9bbbc19d6e60 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:10.064116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 672/1354] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 12 20:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:10.070248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b3c2-b65b-40c5-8e84-d0bdfc1687a7 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:10.070815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b3c2-b65b-40c5-8e84-d0bdfc1687a7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:10.070913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b3c2-b65b-40c5-8e84-d0bdfc1687a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:10.090264 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f119b3c2-b65b-40c5-8e84-d0bdfc1687a7 None None] MFA Rules not processed for user `65431a33849249ed8686d03b0c2e3a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:10.091513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f119b3c2-b65b-40c5-8e84-d0bdfc1687a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:10.100936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 683/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 12 20:30:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:13.880617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78314eb0-a561-4977-a399-54133107c8ac None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:13.881137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78314eb0-a561-4977-a399-54133107c8ac None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:13.881243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78314eb0-a561-4977-a399-54133107c8ac None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:13.882714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 673/1356] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:30:13.887799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1efda-5cbe-4c3a-98d7-6a69e4827a8a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:13.888200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1efda-5cbe-4c3a-98d7-6a69e4827a8a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:13.888353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1efda-5cbe-4c3a-98d7-6a69e4827a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:13.905856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-11e1efda-5cbe-4c3a-98d7-6a69e4827a8a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:13.907033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-11e1efda-5cbe-4c3a-98d7-6a69e4827a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:13.915736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 684/1357] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:13.964845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6353b4-4970-47d5-9440-ae2bebd33923 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:13.965169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6353b4-4970-47d5-9440-ae2bebd33923 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:13.965525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6353b4-4970-47d5-9440-ae2bebd33923 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:13.966978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 674/1358] 10.222.0.59 () {54 vars in 961 bytes} [Thu May 12 20:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:13.972705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2cd9-d3df-430c-9bfd-eb3b11be1fdb None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:13.973014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2cd9-d3df-430c-9bfd-eb3b11be1fdb None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:13.973301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2cd9-d3df-430c-9bfd-eb3b11be1fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:14.023037 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-351a2cd9-d3df-430c-9bfd-eb3b11be1fdb None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:14.024381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-351a2cd9-d3df-430c-9bfd-eb3b11be1fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:14.109716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 685/1359] 10.222.0.59 () {58 vars in 1058 bytes} [Thu May 12 20:30:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:14.118443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6353b4-4970-47d5-9440-ae2bebd33923 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:14.133926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6353b4-4970-47d5-9440-ae2bebd33923 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:14.139675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db0c78-610b-418b-9a27-673e8d5315bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:14.140316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db0c78-610b-418b-9a27-673e8d5315bb service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:14.140602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db0c78-610b-418b-9a27-673e8d5315bb service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:14.140882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db0c78-610b-418b-9a27-673e8d5315bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:14.151697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db0c78-610b-418b-9a27-673e8d5315bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:14.153573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db0c78-610b-418b-9a27-673e8d5315bb service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:14.165190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 675/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:16.638624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fe1ae-3caf-4867-a75a-bd26afbe2f2b None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:16.639239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fe1ae-3caf-4867-a75a-bd26afbe2f2b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:16.639239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fe1ae-3caf-4867-a75a-bd26afbe2f2b None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:16.640606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 686/1361] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:16.646639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e7689-92b2-44ff-ac6a-0d37e9652505 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:16.647118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e7689-92b2-44ff-ac6a-0d37e9652505 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:16.647225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e7689-92b2-44ff-ac6a-0d37e9652505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:16.665017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1a2e7689-92b2-44ff-ac6a-0d37e9652505 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:16.666267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1a2e7689-92b2-44ff-ac6a-0d37e9652505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:16.674073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 676/1362] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:16.719114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fe1ae-3caf-4867-a75a-bd26afbe2f2b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:16.735301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fe1ae-3caf-4867-a75a-bd26afbe2f2b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:16.741684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628b44-a63e-46fe-9cd3-7011f066ec09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:16.742335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628b44-a63e-46fe-9cd3-7011f066ec09 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:16.742622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628b44-a63e-46fe-9cd3-7011f066ec09 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:16.742903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628b44-a63e-46fe-9cd3-7011f066ec09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:16.752237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628b44-a63e-46fe-9cd3-7011f066ec09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:16.755532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628b44-a63e-46fe-9cd3-7011f066ec09 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:16.765744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 687/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:19.563505 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac734-70fe-496d-9e0d-bd027bcee305 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:19.564009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac734-70fe-496d-9e0d-bd027bcee305 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:19.564009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac734-70fe-496d-9e0d-bd027bcee305 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:19.565965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 677/1364] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:19.572273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00183d60-e8f5-4873-904e-7e618a27f9ee None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:19.575735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00183d60-e8f5-4873-904e-7e618a27f9ee None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:19.575735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00183d60-e8f5-4873-904e-7e618a27f9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:19.591759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-00183d60-e8f5-4873-904e-7e618a27f9ee None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:19.592948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-00183d60-e8f5-4873-904e-7e618a27f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:19.602181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 688/1365] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:19.647375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a6a59-c544-473c-8b9c-8a34afc38784 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:19.647666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a6a59-c544-473c-8b9c-8a34afc38784 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:19.647951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a6a59-c544-473c-8b9c-8a34afc38784 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:19.649368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 678/1366] 10.222.0.59 () {54 vars in 961 bytes} [Thu May 12 20:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:19.654567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70b76-55ff-48e6-84ff-9faa1656a9c1 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:19.654856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70b76-55ff-48e6-84ff-9faa1656a9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:19.655134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70b76-55ff-48e6-84ff-9faa1656a9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:19.673467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-0fc70b76-55ff-48e6-84ff-9faa1656a9c1 None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:19.674930 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0fc70b76-55ff-48e6-84ff-9faa1656a9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:19.684085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 689/1367] 10.222.0.59 () {58 vars in 1058 bytes} [Thu May 12 20:30:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:19.692367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a6a59-c544-473c-8b9c-8a34afc38784 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:19.708899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a6a59-c544-473c-8b9c-8a34afc38784 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:19.714856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251def39-1d66-4f25-9318-7aa63af44d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:19.715503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251def39-1d66-4f25-9318-7aa63af44d11 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:19.715789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251def39-1d66-4f25-9318-7aa63af44d11 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:19.716071 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251def39-1d66-4f25-9318-7aa63af44d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:19.724483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251def39-1d66-4f25-9318-7aa63af44d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:19.726097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251def39-1d66-4f25-9318-7aa63af44d11 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:19.735409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 679/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:22.262776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d70b-8b8f-4797-a20f-a284b7421f37 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:22.263285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d70b-8b8f-4797-a20f-a284b7421f37 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:22.263285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d70b-8b8f-4797-a20f-a284b7421f37 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:22.264774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 690/1369] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:22.270826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2df60a-10b8-4808-a93e-b9e888929332 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:22.271296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2df60a-10b8-4808-a93e-b9e888929332 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:22.271390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2df60a-10b8-4808-a93e-b9e888929332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:22.290596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fc2df60a-10b8-4808-a93e-b9e888929332 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:22.291799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fc2df60a-10b8-4808-a93e-b9e888929332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:22.300130 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 680/1370] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:22.320824 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07561-86c3-440e-8928-aa3b234f580b None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:22.321113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07561-86c3-440e-8928-aa3b234f580b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:22.321436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07561-86c3-440e-8928-aa3b234f580b None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:22.322945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 691/1371] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:22.328108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f33ef-cdb6-4985-b0c5-31452ba8b7df None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:22.328405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f33ef-cdb6-4985-b0c5-31452ba8b7df None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:22.328691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f33ef-cdb6-4985-b0c5-31452ba8b7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:22.346883 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07561-86c3-440e-8928-aa3b234f580b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:22.351477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8a1f33ef-cdb6-4985-b0c5-31452ba8b7df None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:22.352803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8a1f33ef-cdb6-4985-b0c5-31452ba8b7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:22.361463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 681/1372] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:22.362569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07561-86c3-440e-8928-aa3b234f580b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:22.368468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cd447-b0bf-4fb9-9af3-180256a5eebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:22.369149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd447-b0bf-4fb9-9af3-180256a5eebd service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:22.369473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd447-b0bf-4fb9-9af3-180256a5eebd service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:22.369753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cd447-b0bf-4fb9-9af3-180256a5eebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:22.379577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cd447-b0bf-4fb9-9af3-180256a5eebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:22.381198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cd447-b0bf-4fb9-9af3-180256a5eebd service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:22.395401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 692/1373] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:30:22.690358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6c00-dc55-4f1b-bcf7-0fc182b96795 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:22.690358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6c00-dc55-4f1b-bcf7-0fc182b96795 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:22.690667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6c00-dc55-4f1b-bcf7-0fc182b96795 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:22.692378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 682/1374] 10.222.0.59 () {54 vars in 963 bytes} [Thu May 12 20:30:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:22.698146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0932a-e7ba-4765-8dad-fbd616ddd50d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:22.699003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0932a-e7ba-4765-8dad-fbd616ddd50d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:22.699003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0932a-e7ba-4765-8dad-fbd616ddd50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:22.756176 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5ef0932a-e7ba-4765-8dad-fbd616ddd50d None None] MFA Rules not processed for user `a32db19a943345b6ba1c91e79739835f`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:22.757450 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5ef0932a-e7ba-4765-8dad-fbd616ddd50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:22.822091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 693/1375] 10.222.0.59 () {58 vars in 1060 bytes} [Thu May 12 20:30:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:22.829912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6c00-dc55-4f1b-bcf7-0fc182b96795 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:22.842213 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6c00-dc55-4f1b-bcf7-0fc182b96795 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:22.846099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97974a-77c4-4a44-8d41-19b53aa7af7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:22.847017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97974a-77c4-4a44-8d41-19b53aa7af7b service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:22.847376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97974a-77c4-4a44-8d41-19b53aa7af7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:22.847881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97974a-77c4-4a44-8d41-19b53aa7af7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:22.857380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97974a-77c4-4a44-8d41-19b53aa7af7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:22.859064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97974a-77c4-4a44-8d41-19b53aa7af7b service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:22.869751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 683/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:30:24.845767 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec8e3-ff80-4a94-a505-59847da03c7b None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:24.847218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec8e3-ff80-4a94-a505-59847da03c7b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:24.847218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec8e3-ff80-4a94-a505-59847da03c7b None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:24.848219 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 694/1377] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:24.853557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0e567-c952-454a-9149-778d07e4233e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:24.854036 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0e567-c952-454a-9149-778d07e4233e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:24.854131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0e567-c952-454a-9149-778d07e4233e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:24.875285 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d4e0e567-c952-454a-9149-778d07e4233e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:24.876545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d4e0e567-c952-454a-9149-778d07e4233e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:24.885489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 684/1378] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:24.933486 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ec8e3-ff80-4a94-a505-59847da03c7b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:24.948554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ec8e3-ff80-4a94-a505-59847da03c7b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:24.958209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31607b-7d49-4714-b50a-e7cc6f685072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:24.959135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31607b-7d49-4714-b50a-e7cc6f685072 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:24.959416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31607b-7d49-4714-b50a-e7cc6f685072 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:24.959691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31607b-7d49-4714-b50a-e7cc6f685072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:24.968767 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31607b-7d49-4714-b50a-e7cc6f685072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:24.970779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31607b-7d49-4714-b50a-e7cc6f685072 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:24.981635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 695/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:27.417183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c7291-de08-4457-b1c9-7366d72dece3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:27.418188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c7291-de08-4457-b1c9-7366d72dece3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:27.418689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c7291-de08-4457-b1c9-7366d72dece3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:27.425023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 685/1380] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:27.427376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d898-dfe3-4a5f-b077-1cd6482e6b39 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:27.427813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d898-dfe3-4a5f-b077-1cd6482e6b39 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:27.428013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d898-dfe3-4a5f-b077-1cd6482e6b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:27.447858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-19f3d898-dfe3-4a5f-b077-1cd6482e6b39 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:27.449052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-19f3d898-dfe3-4a5f-b077-1cd6482e6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:27.461916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 696/1381] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:27.510669 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c7291-de08-4457-b1c9-7366d72dece3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:27.527569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c7291-de08-4457-b1c9-7366d72dece3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:27.534106 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9e42b-8f99-416b-a6ff-1457805cea2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:27.535050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9e42b-8f99-416b-a6ff-1457805cea2a service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:27.536465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9e42b-8f99-416b-a6ff-1457805cea2a service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:27.537574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9e42b-8f99-416b-a6ff-1457805cea2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:27.546812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9e42b-8f99-416b-a6ff-1457805cea2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:27.548639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9e42b-8f99-416b-a6ff-1457805cea2a service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:27.560866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 686/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:30.071420 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9b8f-c7e0-4ba2-a7ab-6d0ea4bf5c38 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:30.071926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9b8f-c7e0-4ba2-a7ab-6d0ea4bf5c38 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:30.071926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9b8f-c7e0-4ba2-a7ab-6d0ea4bf5c38 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:30.073472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 697/1383] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:30.079050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e5286-bc3f-4c50-9701-b633776121b2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:30.079484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e5286-bc3f-4c50-9701-b633776121b2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:30.079611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e5286-bc3f-4c50-9701-b633776121b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:30.099774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-344e5286-bc3f-4c50-9701-b633776121b2 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:30.100984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-344e5286-bc3f-4c50-9701-b633776121b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:30.121086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 687/1384] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:30.161400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad9b8f-c7e0-4ba2-a7ab-6d0ea4bf5c38 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:30.177667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad9b8f-c7e0-4ba2-a7ab-6d0ea4bf5c38 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:30.184364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c0c9b-1490-493b-aee5-6177082ce921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:30.185333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c0c9b-1490-493b-aee5-6177082ce921 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:30.185837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c0c9b-1490-493b-aee5-6177082ce921 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:30.186327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c0c9b-1490-493b-aee5-6177082ce921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:30.200927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c0c9b-1490-493b-aee5-6177082ce921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:30.202839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c0c9b-1490-493b-aee5-6177082ce921 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:30.214596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 698/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:32.543905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf1f06-10ca-4c25-974b-e630da868ea3 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:32.543905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf1f06-10ca-4c25-974b-e630da868ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:32.543905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf1f06-10ca-4c25-974b-e630da868ea3 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:32.543905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 688/1386] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:32.551601 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f28b5-ab48-4be7-a9d1-242308f49667 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:32.552088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f28b5-ab48-4be7-a9d1-242308f49667 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:32.553537 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f28b5-ab48-4be7-a9d1-242308f49667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:32.575785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-6e8f28b5-ab48-4be7-a9d1-242308f49667 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:32.578456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6e8f28b5-ab48-4be7-a9d1-242308f49667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:32.590472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 699/1387] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:32.648657 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf1f06-10ca-4c25-974b-e630da868ea3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:32.666301 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf1f06-10ca-4c25-974b-e630da868ea3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:32.671876 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd0d46-0298-4e9c-a913-c8bea00133e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:32.672801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd0d46-0298-4e9c-a913-c8bea00133e2 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:32.673317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd0d46-0298-4e9c-a913-c8bea00133e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:32.673738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd0d46-0298-4e9c-a913-c8bea00133e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:32.683996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd0d46-0298-4e9c-a913-c8bea00133e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:32.685629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd0d46-0298-4e9c-a913-c8bea00133e2 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:32.695827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 689/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:30:35.237905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523329f7-795c-462a-8663-6fcb371fe8ee None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:35.238468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523329f7-795c-462a-8663-6fcb371fe8ee None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:35.238468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523329f7-795c-462a-8663-6fcb371fe8ee None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:35.240009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 700/1389] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:35.247363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98432-5d0a-489b-9a4b-51bfdceaabdb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:35.247363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98432-5d0a-489b-9a4b-51bfdceaabdb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:35.247363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98432-5d0a-489b-9a4b-51bfdceaabdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:35.265023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f7f98432-5d0a-489b-9a4b-51bfdceaabdb None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:35.266507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f7f98432-5d0a-489b-9a4b-51bfdceaabdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:35.274977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 690/1390] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:35.319198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523329f7-795c-462a-8663-6fcb371fe8ee None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:35.335178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523329f7-795c-462a-8663-6fcb371fe8ee None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:35.348459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ae14b-b9a9-461f-8b36-9709fc6cf1e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:35.349135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ae14b-b9a9-461f-8b36-9709fc6cf1e3 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:35.349784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ae14b-b9a9-461f-8b36-9709fc6cf1e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:35.350237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ae14b-b9a9-461f-8b36-9709fc6cf1e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:35.360480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ae14b-b9a9-461f-8b36-9709fc6cf1e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:35.362795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ae14b-b9a9-461f-8b36-9709fc6cf1e3 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:35.373140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 701/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:38.128154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf084180-6906-4607-bdbf-77417b95235e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:38.128721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf084180-6906-4607-bdbf-77417b95235e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:38.128721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf084180-6906-4607-bdbf-77417b95235e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:38.130001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 691/1392] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:38.135153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c102dc-b7c4-4722-b518-d6ec2c82c434 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:38.135600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c102dc-b7c4-4722-b518-d6ec2c82c434 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:38.135708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c102dc-b7c4-4722-b518-d6ec2c82c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:38.153595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-80c102dc-b7c4-4722-b518-d6ec2c82c434 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:38.154783 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-80c102dc-b7c4-4722-b518-d6ec2c82c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:38.163673 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 702/1393] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:38.208512 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf084180-6906-4607-bdbf-77417b95235e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:38.224431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf084180-6906-4607-bdbf-77417b95235e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:38.231650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f25f1e-2cb0-45f8-b5d3-2896003baf9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:38.232292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f25f1e-2cb0-45f8-b5d3-2896003baf9f service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:38.232574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f25f1e-2cb0-45f8-b5d3-2896003baf9f service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:38.232852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f25f1e-2cb0-45f8-b5d3-2896003baf9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:38.241926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f25f1e-2cb0-45f8-b5d3-2896003baf9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:38.243501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f25f1e-2cb0-45f8-b5d3-2896003baf9f service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:38.253455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 692/1394] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:39.492548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102752-1891-4b6a-b342-90e11484125f None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:39.493147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102752-1891-4b6a-b342-90e11484125f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:39.493147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102752-1891-4b6a-b342-90e11484125f None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:39.494483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 703/1395] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:39.499993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff9ab6-011c-4129-b61f-29a94cc091fa None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:39.500433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff9ab6-011c-4129-b61f-29a94cc091fa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:39.500620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff9ab6-011c-4129-b61f-29a94cc091fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:39.518436 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8fff9ab6-011c-4129-b61f-29a94cc091fa None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:39.519551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8fff9ab6-011c-4129-b61f-29a94cc091fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:39.527572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 693/1396] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:39.592570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58828307-3539-40e3-b5eb-be08595b3955 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:39.592862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58828307-3539-40e3-b5eb-be08595b3955 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:39.593146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58828307-3539-40e3-b5eb-be08595b3955 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:39.594668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 704/1397] 10.222.0.59 () {54 vars in 962 bytes} [Thu May 12 20:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:39.600492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a81013-749e-4880-876b-f79825aaa0fc None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:39.600784 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a81013-749e-4880-876b-f79825aaa0fc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:39.601063 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a81013-749e-4880-876b-f79825aaa0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:39.651289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-05a81013-749e-4880-876b-f79825aaa0fc None None] MFA Rules not processed for user `1f8ec4765e05461a98b3c9eb1d3ced5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:39.652492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-05a81013-749e-4880-876b-f79825aaa0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:39.713946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 694/1398] 10.222.0.59 () {58 vars in 1059 bytes} [Thu May 12 20:30:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:39.722663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58828307-3539-40e3-b5eb-be08595b3955 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:39.733093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58828307-3539-40e3-b5eb-be08595b3955 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:39.736884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2763ce-833d-45f1-9b7b-25574aa3eb67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f8ec4765e05461a98b3c9eb1d3ced5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:39.737543 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2763ce-833d-45f1-9b7b-25574aa3eb67 service glance] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:39.737828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2763ce-833d-45f1-9b7b-25574aa3eb67 service glance] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:39.738106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2763ce-833d-45f1-9b7b-25574aa3eb67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:39.747085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2763ce-833d-45f1-9b7b-25574aa3eb67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:39.748512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2763ce-833d-45f1-9b7b-25574aa3eb67 service glance] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:39.758143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 705/1399] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:40.341678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53fcfb-f9c2-4b5c-b35e-1e7775228ce1 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:40.341976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53fcfb-f9c2-4b5c-b35e-1e7775228ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:40.342264 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53fcfb-f9c2-4b5c-b35e-1e7775228ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:40.392618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7a53fcfb-f9c2-4b5c-b35e-1e7775228ce1 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:40.393573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7a53fcfb-f9c2-4b5c-b35e-1e7775228ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:40.459875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 695/1400] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:40.500971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb436-d0f1-4bd1-9733-2c78bd8cf9f4 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:40.502165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb436-d0f1-4bd1-9733-2c78bd8cf9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:40.502165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb436-d0f1-4bd1-9733-2c78bd8cf9f4 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:40.503748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 706/1401] 10.222.0.59 () {54 vars in 942 bytes} [Thu May 12 20:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:40.510046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f487-e54c-400b-9561-985655a425cb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:40.510494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f487-e54c-400b-9561-985655a425cb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:40.510680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f487-e54c-400b-9561-985655a425cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:40.563035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f082f487-e54c-400b-9561-985655a425cb None None] MFA Rules not processed for user `766497e7e0614adea5769b05f0c1cdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:40.565128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f082f487-e54c-400b-9561-985655a425cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:40.636046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 696/1402] 10.222.0.59 () {58 vars in 1039 bytes} [Thu May 12 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:40.646764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb436-d0f1-4bd1-9733-2c78bd8cf9f4 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:40.660195 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb436-d0f1-4bd1-9733-2c78bd8cf9f4 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:40.665152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76adb1a-9ed5-43ce-a0dd-a3a27086364e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:40.665835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76adb1a-9ed5-43ce-a0dd-a3a27086364e service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:40.666121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76adb1a-9ed5-43ce-a0dd-a3a27086364e service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:40.666403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76adb1a-9ed5-43ce-a0dd-a3a27086364e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:40.675268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76adb1a-9ed5-43ce-a0dd-a3a27086364e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:40.676848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76adb1a-9ed5-43ce-a0dd-a3a27086364e service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:40.685062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 707/1403] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:30:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:30:40.738468 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942b02-218b-42a6-9b3d-0586e10263c1 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:40.738760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942b02-218b-42a6-9b3d-0586e10263c1 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:40.739041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05942b02-218b-42a6-9b3d-0586e10263c1 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:40.740474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 697/1404] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:40.745866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edab92-091f-4f7e-874a-c3734cd92f91 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:40.746158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edab92-091f-4f7e-874a-c3734cd92f91 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:40.746442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edab92-091f-4f7e-874a-c3734cd92f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:40.764588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-44edab92-091f-4f7e-874a-c3734cd92f91 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:40.765840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-44edab92-091f-4f7e-874a-c3734cd92f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:40.775233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 708/1405] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:40.822416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05942b02-218b-42a6-9b3d-0586e10263c1 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:40.837027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05942b02-218b-42a6-9b3d-0586e10263c1 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:40.843171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6bf4e-37bd-4db4-9c42-f25da1ae86b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:40.843863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6bf4e-37bd-4db4-9c42-f25da1ae86b1 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:40.844175 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6bf4e-37bd-4db4-9c42-f25da1ae86b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:40.844456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6bf4e-37bd-4db4-9c42-f25da1ae86b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:40.854284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6bf4e-37bd-4db4-9c42-f25da1ae86b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:40.855923 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6bf4e-37bd-4db4-9c42-f25da1ae86b1 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:40.866682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 698/1406] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:30:43.395143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dbf5a-6f31-49df-b5f2-29698e87cfcc None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:43.395676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dbf5a-6f31-49df-b5f2-29698e87cfcc None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:43.395676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dbf5a-6f31-49df-b5f2-29698e87cfcc None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:43.397374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 709/1407] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:30:43.403734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a9303-e803-4062-b6b0-fe211a7c3998 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:43.404269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a9303-e803-4062-b6b0-fe211a7c3998 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:43.404269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a9303-e803-4062-b6b0-fe211a7c3998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:43.422282 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f53a9303-e803-4062-b6b0-fe211a7c3998 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:30:43.424164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f53a9303-e803-4062-b6b0-fe211a7c3998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:30:43.440167 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 699/1408] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:30:43.477493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dbf5a-6f31-49df-b5f2-29698e87cfcc None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:30:43.492341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dbf5a-6f31-49df-b5f2-29698e87cfcc None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:30:43.497988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e3175-6153-4b2d-9468-dbf7114eccc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:30:43.498662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e3175-6153-4b2d-9468-dbf7114eccc9 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:30:43.498949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e3175-6153-4b2d-9468-dbf7114eccc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:30:43.499473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e3175-6153-4b2d-9468-dbf7114eccc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:30:43.509019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e3175-6153-4b2d-9468-dbf7114eccc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:30:43.511038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e3175-6153-4b2d-9468-dbf7114eccc9 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:30:43.523144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 710/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:06.047193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cc4ed-0a94-40c1-a4e4-0f7dade69025 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:06.048499 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cc4ed-0a94-40c1-a4e4-0f7dade69025 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:06.048644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cc4ed-0a94-40c1-a4e4-0f7dade69025 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:06.050015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 700/1410] 10.222.0.59 () {54 vars in 918 bytes} [Thu May 12 20:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:06.055564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e21266-5adc-4662-bc60-0218c4f8f6a8 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:06.056028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e21266-5adc-4662-bc60-0218c4f8f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:06.056129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e21266-5adc-4662-bc60-0218c4f8f6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:06.075487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-e8e21266-5adc-4662-bc60-0218c4f8f6a8 None None] MFA Rules not processed for user `65431a33849249ed8686d03b0c2e3a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:06.076699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e8e21266-5adc-4662-bc60-0218c4f8f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:06.086817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 711/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Thu May 12 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:06.102016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd5e47-8a4c-4cea-9e17-fb84eb2697c7 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:06.102305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd5e47-8a4c-4cea-9e17-fb84eb2697c7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:06.102581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd5e47-8a4c-4cea-9e17-fb84eb2697c7 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:06.103911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 701/1412] 10.222.0.59 () {54 vars in 918 bytes} [Thu May 12 20:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:06.108511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3680214-60d7-41a3-b555-a26ba770eff3 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:06.108810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3680214-60d7-41a3-b555-a26ba770eff3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:06.109223 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3680214-60d7-41a3-b555-a26ba770eff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:06.130133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-c3680214-60d7-41a3-b555-a26ba770eff3 None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:06.131276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c3680214-60d7-41a3-b555-a26ba770eff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:06.140480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 712/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Thu May 12 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:08.984271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ba438-11ef-4c2b-85e5-9a8db0d93852 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:08.984881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ba438-11ef-4c2b-85e5-9a8db0d93852 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:08.984881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ba438-11ef-4c2b-85e5-9a8db0d93852 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:08.986336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:08.992030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c6744-4a09-4d88-84dc-515f6bdd3d5d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:08.992528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c6744-4a09-4d88-84dc-515f6bdd3d5d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:08.992635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c6744-4a09-4d88-84dc-515f6bdd3d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:09.010303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-043c6744-4a09-4d88-84dc-515f6bdd3d5d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:09.011502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-043c6744-4a09-4d88-84dc-515f6bdd3d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:09.019710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:09.061382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ba438-11ef-4c2b-85e5-9a8db0d93852 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:09.075430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ba438-11ef-4c2b-85e5-9a8db0d93852 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:09.081257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef06b74-b687-4b1d-b4a9-16a265718ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:09.081923 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef06b74-b687-4b1d-b4a9-16a265718ef6 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:09.082211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef06b74-b687-4b1d-b4a9-16a265718ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:09.082493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef06b74-b687-4b1d-b4a9-16a265718ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:09.090401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef06b74-b687-4b1d-b4a9-16a265718ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:09.092022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef06b74-b687-4b1d-b4a9-16a265718ef6 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:09.102014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 703/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:10.101508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116c93-827e-43b6-8087-e10c0c720a17 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:10.102084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116c93-827e-43b6-8087-e10c0c720a17 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:10.102084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b116c93-827e-43b6-8087-e10c0c720a17 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:10.103509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:10.108491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec18d-62a5-4b7d-a698-a9ff89a5419b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:10.108890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec18d-62a5-4b7d-a698-a9ff89a5419b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:10.109049 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec18d-62a5-4b7d-a698-a9ff89a5419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:10.127450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-421ec18d-62a5-4b7d-a698-a9ff89a5419b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:10.128562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-421ec18d-62a5-4b7d-a698-a9ff89a5419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:10.136254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:10.306928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116c93-827e-43b6-8087-e10c0c720a17 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:10.320856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b116c93-827e-43b6-8087-e10c0c720a17 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:10.326294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0d33f-14a2-4dcf-9d30-b0919e7ea37d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:10.326929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0d33f-14a2-4dcf-9d30-b0919e7ea37d service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:10.327214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0d33f-14a2-4dcf-9d30-b0919e7ea37d service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:10.327491 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0d33f-14a2-4dcf-9d30-b0919e7ea37d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:10.336249 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0d33f-14a2-4dcf-9d30-b0919e7ea37d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:10.337864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0d33f-14a2-4dcf-9d30-b0919e7ea37d service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:10.347730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 715/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:11.309165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551040e-3ec7-42ed-86c2-4f1d2d73ac63 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:11.309707 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551040e-3ec7-42ed-86c2-4f1d2d73ac63 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:11.309805 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551040e-3ec7-42ed-86c2-4f1d2d73ac63 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:11.311141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:11.316203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f727-f86d-4076-963b-eb24b4f3f897 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:11.316592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f727-f86d-4076-963b-eb24b4f3f897 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:11.316775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f727-f86d-4076-963b-eb24b4f3f897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:11.334930 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-1377f727-f86d-4076-963b-eb24b4f3f897 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:11.336128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1377f727-f86d-4076-963b-eb24b4f3f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:11.344655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:11.498173 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551040e-3ec7-42ed-86c2-4f1d2d73ac63 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:11.513021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551040e-3ec7-42ed-86c2-4f1d2d73ac63 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:11.519341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154048e-23a0-464f-a6bb-5b44e15da808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:11.519922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154048e-23a0-464f-a6bb-5b44e15da808 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:11.520214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154048e-23a0-464f-a6bb-5b44e15da808 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:11.520495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154048e-23a0-464f-a6bb-5b44e15da808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:11.528503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154048e-23a0-464f-a6bb-5b44e15da808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:11.530121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154048e-23a0-464f-a6bb-5b44e15da808 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:11.539398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 706/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:12.468535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f616c-be3b-4dec-8b5f-113a6869fc2e None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:12.469928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f616c-be3b-4dec-8b5f-113a6869fc2e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:12.469928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f616c-be3b-4dec-8b5f-113a6869fc2e None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:12.471206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:12.476073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bbd47-8863-4446-8630-494e457411dd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:12.476528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bbd47-8863-4446-8630-494e457411dd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:12.476636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bbd47-8863-4446-8630-494e457411dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:12.496061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2a8bbd47-8863-4446-8630-494e457411dd None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:12.497236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2a8bbd47-8863-4446-8630-494e457411dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:12.505880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:12.654574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f616c-be3b-4dec-8b5f-113a6869fc2e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:12.669622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f616c-be3b-4dec-8b5f-113a6869fc2e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:12.675667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc53cd6-6e88-4a0e-a391-41e22151df08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:12.676320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc53cd6-6e88-4a0e-a391-41e22151df08 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:12.676610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc53cd6-6e88-4a0e-a391-41e22151df08 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:12.676896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc53cd6-6e88-4a0e-a391-41e22151df08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:12.685092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc53cd6-6e88-4a0e-a391-41e22151df08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:12.686720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc53cd6-6e88-4a0e-a391-41e22151df08 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:12.696042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 718/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:13.633752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751161a4-a63d-48d4-9df2-66a5cb9137ee None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:13.634334 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751161a4-a63d-48d4-9df2-66a5cb9137ee None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:13.634334 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751161a4-a63d-48d4-9df2-66a5cb9137ee None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:13.635659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:13.640591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80926183-74ee-4596-a09c-aa722e48d84f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:13.641010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80926183-74ee-4596-a09c-aa722e48d84f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:13.641197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80926183-74ee-4596-a09c-aa722e48d84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:13.658900 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-80926183-74ee-4596-a09c-aa722e48d84f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:13.660127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-80926183-74ee-4596-a09c-aa722e48d84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:13.668098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:13.821606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751161a4-a63d-48d4-9df2-66a5cb9137ee None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:13.835895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751161a4-a63d-48d4-9df2-66a5cb9137ee None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:13.841233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9cb50-00fd-4830-9c81-67fd26fbf544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:13.841897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9cb50-00fd-4830-9c81-67fd26fbf544 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:13.842178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9cb50-00fd-4830-9c81-67fd26fbf544 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:13.842455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9cb50-00fd-4830-9c81-67fd26fbf544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:13.851535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9cb50-00fd-4830-9c81-67fd26fbf544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:13.853218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9cb50-00fd-4830-9c81-67fd26fbf544 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:13.864020 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 709/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:14.789182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4e07-1615-4596-9dc5-cd2e29e9684d None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:14.789756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4e07-1615-4596-9dc5-cd2e29e9684d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:14.789756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4e07-1615-4596-9dc5-cd2e29e9684d None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:14.791204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:14.796190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271661-221e-4073-ace5-f590ed11b6bf None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:14.796602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271661-221e-4073-ace5-f590ed11b6bf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:14.796755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271661-221e-4073-ace5-f590ed11b6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:14.814955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-51271661-221e-4073-ace5-f590ed11b6bf None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:14.816145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-51271661-221e-4073-ace5-f590ed11b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:14.823873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:14.986038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a4e07-1615-4596-9dc5-cd2e29e9684d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:15.001498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a4e07-1615-4596-9dc5-cd2e29e9684d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:15.006957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd51155-11b9-4020-aaf6-ace55163f564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:15.007595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51155-11b9-4020-aaf6-ace55163f564 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:15.007875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51155-11b9-4020-aaf6-ace55163f564 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:15.008149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51155-11b9-4020-aaf6-ace55163f564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:15.016560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd51155-11b9-4020-aaf6-ace55163f564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:15.018162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd51155-11b9-4020-aaf6-ace55163f564 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:15.027503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 721/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:15.970120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc914e-0a7c-45c4-af99-4838c5f2e0ed None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:15.970690 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc914e-0a7c-45c4-af99-4838c5f2e0ed None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:15.970690 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc914e-0a7c-45c4-af99-4838c5f2e0ed None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:15.972032 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:15.977071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520dfc-1d3a-4a9c-9866-8066561e65e7 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:15.977527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520dfc-1d3a-4a9c-9866-8066561e65e7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:15.977661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520dfc-1d3a-4a9c-9866-8066561e65e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:15.995731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5f520dfc-1d3a-4a9c-9866-8066561e65e7 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:15.996904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5f520dfc-1d3a-4a9c-9866-8066561e65e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:16.005812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:16.155798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc914e-0a7c-45c4-af99-4838c5f2e0ed None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:16.170200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc914e-0a7c-45c4-af99-4838c5f2e0ed None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:16.175671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80081934-a36f-48c6-82fa-d3352e2adcb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:16.176315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80081934-a36f-48c6-82fa-d3352e2adcb9 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:16.176603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80081934-a36f-48c6-82fa-d3352e2adcb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:16.176883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80081934-a36f-48c6-82fa-d3352e2adcb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:16.184736 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80081934-a36f-48c6-82fa-d3352e2adcb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:16.186343 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80081934-a36f-48c6-82fa-d3352e2adcb9 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:16.196010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 712/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:17.120742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07224-b249-4fd7-b794-2ff20b8a2177 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:17.121311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07224-b249-4fd7-b794-2ff20b8a2177 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:17.121311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07224-b249-4fd7-b794-2ff20b8a2177 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:17.122614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:17.128384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44674d31-6c33-471a-991f-86772a14b498 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:17.128820 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44674d31-6c33-471a-991f-86772a14b498 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:17.128929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44674d31-6c33-471a-991f-86772a14b498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:17.146426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-44674d31-6c33-471a-991f-86772a14b498 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:17.147622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-44674d31-6c33-471a-991f-86772a14b498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:17.155323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:17.304661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada07224-b249-4fd7-b794-2ff20b8a2177 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:17.319636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada07224-b249-4fd7-b794-2ff20b8a2177 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:17.324980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4da06b-8662-4d1e-b648-11eb35b0007d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:17.325651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4da06b-8662-4d1e-b648-11eb35b0007d service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:17.325941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4da06b-8662-4d1e-b648-11eb35b0007d service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:17.326222 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4da06b-8662-4d1e-b648-11eb35b0007d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:17.334227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4da06b-8662-4d1e-b648-11eb35b0007d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:17.335802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4da06b-8662-4d1e-b648-11eb35b0007d service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:17.345720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 724/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:18.311331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc889-c0fc-4238-972f-09c44d1791a2 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:18.311891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc889-c0fc-4238-972f-09c44d1791a2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:18.311891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc889-c0fc-4238-972f-09c44d1791a2 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:18.313840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:18.318695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186cb33-95f8-4b5d-a069-ed3237a2c60d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:18.319134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186cb33-95f8-4b5d-a069-ed3237a2c60d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:18.319260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186cb33-95f8-4b5d-a069-ed3237a2c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:18.337621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8186cb33-95f8-4b5d-a069-ed3237a2c60d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:18.338812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8186cb33-95f8-4b5d-a069-ed3237a2c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:18.346778 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:18.512373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebc889-c0fc-4238-972f-09c44d1791a2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:18.529393 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebc889-c0fc-4238-972f-09c44d1791a2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:18.534924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a28089-ed1a-43ed-ba18-2aa205653302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:18.535565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a28089-ed1a-43ed-ba18-2aa205653302 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:18.535847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a28089-ed1a-43ed-ba18-2aa205653302 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:18.536122 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a28089-ed1a-43ed-ba18-2aa205653302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:18.544088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a28089-ed1a-43ed-ba18-2aa205653302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:18.545687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a28089-ed1a-43ed-ba18-2aa205653302 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:18.555245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 715/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:20.653635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e0e4c-84e3-496b-894c-0b17ea098b8f None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:20.654245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e0e4c-84e3-496b-894c-0b17ea098b8f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:20.654245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e0e4c-84e3-496b-894c-0b17ea098b8f None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:20.655558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:20.661693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfccd1-70bb-4a2d-aa9e-78c0eb30026d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:20.662118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfccd1-70bb-4a2d-aa9e-78c0eb30026d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:20.662241 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfccd1-70bb-4a2d-aa9e-78c0eb30026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:20.680167 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7adfccd1-70bb-4a2d-aa9e-78c0eb30026d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:20.681385 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7adfccd1-70bb-4a2d-aa9e-78c0eb30026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:20.689045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:20.726587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e0e4c-84e3-496b-894c-0b17ea098b8f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:20.728333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9a7e0e4c-84e3-496b-894c-0b17ea098b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:20.741563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e0e4c-84e3-496b-894c-0b17ea098b8f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:20.745029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4383af-1797-4b9f-b4e1-346f116977a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:20.745699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4383af-1797-4b9f-b4e1-346f116977a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:20.745989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4383af-1797-4b9f-b4e1-346f116977a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:20.746273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4383af-1797-4b9f-b4e1-346f116977a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:20.755188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4383af-1797-4b9f-b4e1-346f116977a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:20.756611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4383af-1797-4b9f-b4e1-346f116977a0 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:20.765778 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 727/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:23.138614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913be03-d711-44b6-9e7e-4cd2b37a56fe None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:23.139134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913be03-d711-44b6-9e7e-4cd2b37a56fe None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:23.139134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913be03-d711-44b6-9e7e-4cd2b37a56fe None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:23.140828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:23.145831 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db687c-6834-44f3-9450-8908b94cab9a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:23.146291 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db687c-6834-44f3-9450-8908b94cab9a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:23.146389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db687c-6834-44f3-9450-8908b94cab9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:23.163468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-12db687c-6834-44f3-9450-8908b94cab9a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:23.164653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-12db687c-6834-44f3-9450-8908b94cab9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:23.172942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:23.210295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913be03-d711-44b6-9e7e-4cd2b37a56fe None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:23.220840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913be03-d711-44b6-9e7e-4cd2b37a56fe None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:23.226338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdfbe9-2d92-4f3b-b48d-75a7f4fc6315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:23.227037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdfbe9-2d92-4f3b-b48d-75a7f4fc6315 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:23.227327 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdfbe9-2d92-4f3b-b48d-75a7f4fc6315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:23.227607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdfbe9-2d92-4f3b-b48d-75a7f4fc6315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:23.239938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdfbe9-2d92-4f3b-b48d-75a7f4fc6315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:23.241487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdfbe9-2d92-4f3b-b48d-75a7f4fc6315 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:23.257699 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 718/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:25.871439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4244d7-161c-498f-890a-a9566ddf3eff None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:25.871910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4244d7-161c-498f-890a-a9566ddf3eff None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:25.872013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4244d7-161c-498f-890a-a9566ddf3eff None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:25.873394 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:25.879049 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3610ef2-040b-4ff8-8100-69f2ef260b4e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:25.879500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3610ef2-040b-4ff8-8100-69f2ef260b4e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:25.879625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3610ef2-040b-4ff8-8100-69f2ef260b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:25.896951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c3610ef2-040b-4ff8-8100-69f2ef260b4e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:25.898188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c3610ef2-040b-4ff8-8100-69f2ef260b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:25.906462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:25.944132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4244d7-161c-498f-890a-a9566ddf3eff None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:25.955129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4244d7-161c-498f-890a-a9566ddf3eff None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:25.958699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa4b08-44a4-440e-9b0e-f42e23ebfe70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:25.959346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa4b08-44a4-440e-9b0e-f42e23ebfe70 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:25.959635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa4b08-44a4-440e-9b0e-f42e23ebfe70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:25.959915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa4b08-44a4-440e-9b0e-f42e23ebfe70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:25.969253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa4b08-44a4-440e-9b0e-f42e23ebfe70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:25.970710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa4b08-44a4-440e-9b0e-f42e23ebfe70 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:25.979845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 730/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:28.349764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dab8f-6a7e-4ba4-a720-d703f8c19f36 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:28.350313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dab8f-6a7e-4ba4-a720-d703f8c19f36 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:28.350313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dab8f-6a7e-4ba4-a720-d703f8c19f36 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:28.351690 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:28.356934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f568-edbc-4838-bced-ef7b3285e19a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:28.357349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f568-edbc-4838-bced-ef7b3285e19a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:28.357541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f568-edbc-4838-bced-ef7b3285e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:28.377006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-62c0f568-edbc-4838-bced-ef7b3285e19a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:28.378210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-62c0f568-edbc-4838-bced-ef7b3285e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:28.385782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:28.424645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dab8f-6a7e-4ba4-a720-d703f8c19f36 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:28.435137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dab8f-6a7e-4ba4-a720-d703f8c19f36 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:28.439289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e368-b250-4e37-af33-977d56c03e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:28.439918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e368-b250-4e37-af33-977d56c03e2c service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:28.440202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e368-b250-4e37-af33-977d56c03e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:28.440476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e368-b250-4e37-af33-977d56c03e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:28.449133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7e368-b250-4e37-af33-977d56c03e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:28.450579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7e368-b250-4e37-af33-977d56c03e2c service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:28.459869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 721/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:30.863201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350afdda-539d-4603-a39b-4b0edcca014b None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:30.863655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350afdda-539d-4603-a39b-4b0edcca014b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:30.863794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350afdda-539d-4603-a39b-4b0edcca014b None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:30.865232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:30.870760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219df9e-76aa-45a1-9212-28b1b87f3913 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:30.871215 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219df9e-76aa-45a1-9212-28b1b87f3913 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:30.871406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219df9e-76aa-45a1-9212-28b1b87f3913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:30.891840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1219df9e-76aa-45a1-9212-28b1b87f3913 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:30.893037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1219df9e-76aa-45a1-9212-28b1b87f3913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:30.900643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:30.939578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350afdda-539d-4603-a39b-4b0edcca014b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:30.954979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350afdda-539d-4603-a39b-4b0edcca014b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:30.959488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7bc33-9624-40c3-8c51-d465ca2d1617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:30.960329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7bc33-9624-40c3-8c51-d465ca2d1617 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:30.960775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7bc33-9624-40c3-8c51-d465ca2d1617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:30.961116 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7bc33-9624-40c3-8c51-d465ca2d1617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:30.971267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7bc33-9624-40c3-8c51-d465ca2d1617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:30.972772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7bc33-9624-40c3-8c51-d465ca2d1617 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:30.982124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 733/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:33.284023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cc4f-9511-491e-a893-4eeeeac26a4b None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:33.284447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cc4f-9511-491e-a893-4eeeeac26a4b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:33.284583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cc4f-9511-491e-a893-4eeeeac26a4b None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:33.285991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:33.291237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fadc02-57df-404b-8e68-ff74033b3e5b None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:33.291698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fadc02-57df-404b-8e68-ff74033b3e5b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:33.291807 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fadc02-57df-404b-8e68-ff74033b3e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:33.310268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-56fadc02-57df-404b-8e68-ff74033b3e5b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:33.311458 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-56fadc02-57df-404b-8e68-ff74033b3e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:33.319351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:33.356330 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09cc4f-9511-491e-a893-4eeeeac26a4b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:33.367896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09cc4f-9511-491e-a893-4eeeeac26a4b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:33.373310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2861c8-b98c-4f9c-9aec-51aceb772e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:33.373947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2861c8-b98c-4f9c-9aec-51aceb772e86 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:33.375705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2861c8-b98c-4f9c-9aec-51aceb772e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:33.375991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2861c8-b98c-4f9c-9aec-51aceb772e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:33.384663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2861c8-b98c-4f9c-9aec-51aceb772e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:33.386095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2861c8-b98c-4f9c-9aec-51aceb772e86 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:33.395281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 724/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:35.691378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fc449-50ac-4a0b-94d9-102dea8d13c4 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:35.691964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fc449-50ac-4a0b-94d9-102dea8d13c4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:35.691964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fc449-50ac-4a0b-94d9-102dea8d13c4 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:35.693401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:35.698714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e66574-e7cc-40b0-9a22-9fcead90cd85 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:35.699144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e66574-e7cc-40b0-9a22-9fcead90cd85 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:35.699276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e66574-e7cc-40b0-9a22-9fcead90cd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:35.717363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-71e66574-e7cc-40b0-9a22-9fcead90cd85 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:35.718643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-71e66574-e7cc-40b0-9a22-9fcead90cd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:35.726690 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:35.763849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fc449-50ac-4a0b-94d9-102dea8d13c4 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:35.774876 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fc449-50ac-4a0b-94d9-102dea8d13c4 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:35.778375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60b1b5-a43a-44c7-9707-0680d2f4ec31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:35.779013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b1b5-a43a-44c7-9707-0680d2f4ec31 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:35.779294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b1b5-a43a-44c7-9707-0680d2f4ec31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:35.779570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60b1b5-a43a-44c7-9707-0680d2f4ec31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:35.789070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60b1b5-a43a-44c7-9707-0680d2f4ec31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:35.801339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60b1b5-a43a-44c7-9707-0680d2f4ec31 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:35.801339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 736/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:38.060218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c3dd9-4019-406d-bfe0-b769224dcb35 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:38.060788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c3dd9-4019-406d-bfe0-b769224dcb35 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:38.060788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c3dd9-4019-406d-bfe0-b769224dcb35 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:38.062181 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:38.067457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d82407-fc6e-4604-836c-671de6bd92a9 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:38.067887 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d82407-fc6e-4604-836c-671de6bd92a9 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:38.068057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d82407-fc6e-4604-836c-671de6bd92a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:38.085953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-51d82407-fc6e-4604-836c-671de6bd92a9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:38.087136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-51d82407-fc6e-4604-836c-671de6bd92a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:38.095910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:38.131854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c3dd9-4019-406d-bfe0-b769224dcb35 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:38.143045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c3dd9-4019-406d-bfe0-b769224dcb35 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:38.146659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f819e-7a6d-4eb0-8a49-583c1a4a3da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:38.147292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f819e-7a6d-4eb0-8a49-583c1a4a3da2 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:38.147575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f819e-7a6d-4eb0-8a49-583c1a4a3da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:38.147849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f819e-7a6d-4eb0-8a49-583c1a4a3da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:38.157163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f819e-7a6d-4eb0-8a49-583c1a4a3da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:38.158601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f819e-7a6d-4eb0-8a49-583c1a4a3da2 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:38.168081 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 727/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:40.418003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232944-85c2-4993-bfce-99325a8cb4ec None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:40.418604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232944-85c2-4993-bfce-99325a8cb4ec None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:40.418604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232944-85c2-4993-bfce-99325a8cb4ec None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:40.419994 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:40.425650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0241-f448-4e67-89a2-541f47f04edc None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:40.426086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0241-f448-4e67-89a2-541f47f04edc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:40.426269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0241-f448-4e67-89a2-541f47f04edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:40.443678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e90e0241-f448-4e67-89a2-541f47f04edc None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:40.444860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e90e0241-f448-4e67-89a2-541f47f04edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:40.453134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:31:40.488926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232944-85c2-4993-bfce-99325a8cb4ec None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:40.499640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232944-85c2-4993-bfce-99325a8cb4ec None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:40.503277 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e8117-2d51-41f4-a6df-37ccd80234fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:40.503885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e8117-2d51-41f4-a6df-37ccd80234fd service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:40.504171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e8117-2d51-41f4-a6df-37ccd80234fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:40.504451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e8117-2d51-41f4-a6df-37ccd80234fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:40.513121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e8117-2d51-41f4-a6df-37ccd80234fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:40.515266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e8117-2d51-41f4-a6df-37ccd80234fd service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:40.524581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 739/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:31:42.784360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d388c-7588-49bb-ac5d-1d754cf9ae22 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:42.784908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d388c-7588-49bb-ac5d-1d754cf9ae22 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:42.784908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d388c-7588-49bb-ac5d-1d754cf9ae22 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:42.786313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:31:42.791503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557d0c-781a-48a5-ac56-cae8958d54f2 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:42.791912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557d0c-781a-48a5-ac56-cae8958d54f2 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:42.792068 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557d0c-781a-48a5-ac56-cae8958d54f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:42.809135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5f557d0c-781a-48a5-ac56-cae8958d54f2 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:31:42.810352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5f557d0c-781a-48a5-ac56-cae8958d54f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:31:42.818058 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:31:42.854203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d388c-7588-49bb-ac5d-1d754cf9ae22 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:31:42.864989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d388c-7588-49bb-ac5d-1d754cf9ae22 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:31:42.868494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3b5d0-cccb-4638-b528-c31ee5ab2d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:31:42.869137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3b5d0-cccb-4638-b528-c31ee5ab2d85 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:31:42.869463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3b5d0-cccb-4638-b528-c31ee5ab2d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:31:42.869743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3b5d0-cccb-4638-b528-c31ee5ab2d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:31:42.878796 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3b5d0-cccb-4638-b528-c31ee5ab2d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:31:42.880211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3b5d0-cccb-4638-b528-c31ee5ab2d85 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:31:42.889853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 730/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:32:17.208374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535ea0-3bb3-4f26-84df-57d57f5de5a8 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:17.208951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535ea0-3bb3-4f26-84df-57d57f5de5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:17.208951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535ea0-3bb3-4f26-84df-57d57f5de5a8 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:17.210276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 741/1471] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:32:17.215292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5b29f-9d19-47bb-999a-68fbdf70062a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:17.215753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5b29f-9d19-47bb-999a-68fbdf70062a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:17.215852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5b29f-9d19-47bb-999a-68fbdf70062a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:17.234205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-eea5b29f-9d19-47bb-999a-68fbdf70062a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:32:17.235384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-eea5b29f-9d19-47bb-999a-68fbdf70062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:32:17.243103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 731/1472] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:32:17.290589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51a049-31d3-4048-814c-39c67385f4ee None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:17.290769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51a049-31d3-4048-814c-39c67385f4ee None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:17.291049 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51a049-31d3-4048-814c-39c67385f4ee None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:17.292404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 742/1473] 10.222.0.59 () {54 vars in 962 bytes} [Thu May 12 20:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:32:17.297308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46978b-af07-4bdb-ab53-3950633b0b07 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:17.297604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46978b-af07-4bdb-ab53-3950633b0b07 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:17.297938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46978b-af07-4bdb-ab53-3950633b0b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:17.316310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6a46978b-af07-4bdb-ab53-3950633b0b07 None None] MFA Rules not processed for user `1f8ec4765e05461a98b3c9eb1d3ced5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:32:17.317580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6a46978b-af07-4bdb-ab53-3950633b0b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:32:17.324298 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 732/1474] 10.222.0.59 () {58 vars in 1059 bytes} [Thu May 12 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:32:17.332300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51a049-31d3-4048-814c-39c67385f4ee None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:32:17.343943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51a049-31d3-4048-814c-39c67385f4ee None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:32:17.347770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5e095-cc8c-4384-a915-9fab775dfe8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f8ec4765e05461a98b3c9eb1d3ced5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:32:17.348407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5e095-cc8c-4384-a915-9fab775dfe8f service glance] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:17.348692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5e095-cc8c-4384-a915-9fab775dfe8f service glance] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:17.348969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5e095-cc8c-4384-a915-9fab775dfe8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:17.357868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5e095-cc8c-4384-a915-9fab775dfe8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:32:17.359622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5e095-cc8c-4384-a915-9fab775dfe8f service glance] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:32:17.368758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 743/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:32:19.677019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef20075-272f-4ea0-9ad9-dcebe8ea4abd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:19.677821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef20075-272f-4ea0-9ad9-dcebe8ea4abd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:19.677821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef20075-272f-4ea0-9ad9-dcebe8ea4abd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:19.679059 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 733/1476] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:32:19.684199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74383d39-7c2b-40cd-9422-4332f30e80ae None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:19.684656 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74383d39-7c2b-40cd-9422-4332f30e80ae None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:19.684757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74383d39-7c2b-40cd-9422-4332f30e80ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:19.703103 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-74383d39-7c2b-40cd-9422-4332f30e80ae None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:32:19.704274 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-74383d39-7c2b-40cd-9422-4332f30e80ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:32:19.711909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 744/1477] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:32:19.734155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef20075-272f-4ea0-9ad9-dcebe8ea4abd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:32:19.746538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef20075-272f-4ea0-9ad9-dcebe8ea4abd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:32:19.751975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbbd6f-ecd8-4283-846b-a88bbdbcabe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:32:19.752621 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbbd6f-ecd8-4283-846b-a88bbdbcabe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:19.752909 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbbd6f-ecd8-4283-846b-a88bbdbcabe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:19.753233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbbd6f-ecd8-4283-846b-a88bbdbcabe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:19.754004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbbd6f-ecd8-4283-846b-a88bbdbcabe9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:32:19.755861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-f2bbbd6f-ecd8-4283-846b-a88bbdbcabe9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:32:19.755861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: warnings.warn(msg) May 12 20:32:19.755861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: May 12 20:32:19.757002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbbd6f-ecd8-4283-846b-a88bbdbcabe9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:32:19.776465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 734/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Thu May 12 20:32:19 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:32:22.067515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55be5f-b98c-431e-ab3b-533fbdec1c73 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:22.068087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55be5f-b98c-431e-ab3b-533fbdec1c73 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:22.068087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55be5f-b98c-431e-ab3b-533fbdec1c73 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:22.069539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 745/1479] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:32:22.074943 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73728-5baa-4f42-8afb-f3b5092531f4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:22.075354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73728-5baa-4f42-8afb-f3b5092531f4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:22.075510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73728-5baa-4f42-8afb-f3b5092531f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:22.093702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4ce73728-5baa-4f42-8afb-f3b5092531f4 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:32:22.094905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4ce73728-5baa-4f42-8afb-f3b5092531f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:32:22.102587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 735/1480] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:32:22.145215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55be5f-b98c-431e-ab3b-533fbdec1c73 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:32:22.159340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55be5f-b98c-431e-ab3b-533fbdec1c73 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:32:22.164628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f4641-64e1-4340-a457-c47bc33b60ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:32:22.165261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f4641-64e1-4340-a457-c47bc33b60ce service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:22.165576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f4641-64e1-4340-a457-c47bc33b60ce service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:22.165855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f4641-64e1-4340-a457-c47bc33b60ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:22.173804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f4641-64e1-4340-a457-c47bc33b60ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:32:22.175369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f4641-64e1-4340-a457-c47bc33b60ce service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:32:22.184424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 746/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:32:24.593560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a6252-8f5f-4b72-85dd-a8cec5d89d6f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:24.594180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a6252-8f5f-4b72-85dd-a8cec5d89d6f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:24.594281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a6252-8f5f-4b72-85dd-a8cec5d89d6f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:24.595608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 736/1482] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:32:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:32:24.601463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178f1cc-eb40-4348-88ff-ca8e4c0c800f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:24.601949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178f1cc-eb40-4348-88ff-ca8e4c0c800f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:24.602075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178f1cc-eb40-4348-88ff-ca8e4c0c800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:24.619596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f178f1cc-eb40-4348-88ff-ca8e4c0c800f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:32:24.620778 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f178f1cc-eb40-4348-88ff-ca8e4c0c800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:32:24.629308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 747/1483] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:32:24.666935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a6252-8f5f-4b72-85dd-a8cec5d89d6f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:32:24.677341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a6252-8f5f-4b72-85dd-a8cec5d89d6f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:32:24.680828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97e7a8-52ee-4213-9b05-43c204e69377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:32:24.681499 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97e7a8-52ee-4213-9b05-43c204e69377 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:24.681783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97e7a8-52ee-4213-9b05-43c204e69377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:24.682059 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97e7a8-52ee-4213-9b05-43c204e69377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:24.691068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97e7a8-52ee-4213-9b05-43c204e69377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:32:24.692559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97e7a8-52ee-4213-9b05-43c204e69377 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:32:24.704214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 737/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:32:27.021073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04b74-f554-4460-a06e-988b913c6ce5 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:27.021718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04b74-f554-4460-a06e-988b913c6ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:27.021718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04b74-f554-4460-a06e-988b913c6ce5 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:27.023014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 748/1485] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:32:27.028157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26781a-4f22-47a1-a589-65c4c3104440 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:27.028573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26781a-4f22-47a1-a589-65c4c3104440 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:27.028786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26781a-4f22-47a1-a589-65c4c3104440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:27.046704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8e26781a-4f22-47a1-a589-65c4c3104440 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:32:27.047887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8e26781a-4f22-47a1-a589-65c4c3104440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:32:27.055829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 738/1486] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:32:27.094660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac04b74-f554-4460-a06e-988b913c6ce5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:32:27.105619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac04b74-f554-4460-a06e-988b913c6ce5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:32:27.109236 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb1f31-746e-4272-934c-a38d25920261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:32:27.109904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb1f31-746e-4272-934c-a38d25920261 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:27.110217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb1f31-746e-4272-934c-a38d25920261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:27.110500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb1f31-746e-4272-934c-a38d25920261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:27.119621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb1f31-746e-4272-934c-a38d25920261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:32:27.120979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb1f31-746e-4272-934c-a38d25920261 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:32:27.130950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 749/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:32:29.496017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0db1-843b-4d4b-b7cc-240cee229e34 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:29.496582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0db1-843b-4d4b-b7cc-240cee229e34 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:29.496582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0db1-843b-4d4b-b7cc-240cee229e34 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:29.498027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 739/1488] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:32:29.503555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4fb4-c46b-4087-9998-f9766890d7f6 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:29.503995 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4fb4-c46b-4087-9998-f9766890d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:29.504157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4fb4-c46b-4087-9998-f9766890d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:29.521660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-45ab4fb4-c46b-4087-9998-f9766890d7f6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:32:29.522859 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-45ab4fb4-c46b-4087-9998-f9766890d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:32:29.531403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 750/1489] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:32:29.571088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0db1-843b-4d4b-b7cc-240cee229e34 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:32:29.582119 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0db1-843b-4d4b-b7cc-240cee229e34 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:32:29.589872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d283ab-54f1-41fb-acdf-2f1ec5fc7fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:32:29.589872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d283ab-54f1-41fb-acdf-2f1ec5fc7fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:29.589872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d283ab-54f1-41fb-acdf-2f1ec5fc7fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:29.589872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d283ab-54f1-41fb-acdf-2f1ec5fc7fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:29.596277 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d283ab-54f1-41fb-acdf-2f1ec5fc7fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:32:29.597717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d283ab-54f1-41fb-acdf-2f1ec5fc7fe4 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:32:29.606719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 740/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:32:32.202916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214582-36c2-4fbc-978c-92977f7a5dbc None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:32.203459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214582-36c2-4fbc-978c-92977f7a5dbc None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:32.203459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214582-36c2-4fbc-978c-92977f7a5dbc None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:32.204754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 751/1491] 10.222.0.59 () {54 vars in 926 bytes} [Thu May 12 20:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:32:32.209860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aa55f-9b08-4ab4-a9bd-1b018fd0cb0b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:32.210251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aa55f-9b08-4ab4-a9bd-1b018fd0cb0b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:32.210415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aa55f-9b08-4ab4-a9bd-1b018fd0cb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:32.227800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-706aa55f-9b08-4ab4-a9bd-1b018fd0cb0b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:32:32.228997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-706aa55f-9b08-4ab4-a9bd-1b018fd0cb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:32:32.237374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 741/1492] 10.222.0.59 () {58 vars in 1023 bytes} [Thu May 12 20:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:32:32.276468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79214582-36c2-4fbc-978c-92977f7a5dbc None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:32:32.287326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79214582-36c2-4fbc-978c-92977f7a5dbc None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:32:32.290901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da112339-a3d6-4270-9aeb-b65c4a696035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:32:32.291538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da112339-a3d6-4270-9aeb-b65c4a696035 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:32:32.291936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da112339-a3d6-4270-9aeb-b65c4a696035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:32:32.292242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da112339-a3d6-4270-9aeb-b65c4a696035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:32:32.301597 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da112339-a3d6-4270-9aeb-b65c4a696035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:32:32.303136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da112339-a3d6-4270-9aeb-b65c4a696035 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:32:32.312840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 752/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:34:09.136929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e931f-20a1-448b-a97d-656fa2d45120 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.137540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e931f-20a1-448b-a97d-656fa2d45120 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.137984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e931f-20a1-448b-a97d-656fa2d45120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.159392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-296e931f-20a1-448b-a97d-656fa2d45120 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:34:09.160911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-296e931f-20a1-448b-a97d-656fa2d45120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:34:09.169975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 742/1494] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:34:09.179453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572bfb-616d-4716-9c58-be16787a4b31 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.179985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572bfb-616d-4716-9c58-be16787a4b31 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.180180 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572bfb-616d-4716-9c58-be16787a4b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.200323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f3572bfb-616d-4716-9c58-be16787a4b31 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:34:09.201560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f3572bfb-616d-4716-9c58-be16787a4b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:34:09.209381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 753/1495] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:34:09.214409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e931f-20a1-448b-a97d-656fa2d45120 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:34:09.223878 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e931f-20a1-448b-a97d-656fa2d45120 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:34:09.229238 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693197f-29dc-406d-92f0-18db561e1f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:34:09.230022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693197f-29dc-406d-92f0-18db561e1f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.230266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693197f-29dc-406d-92f0-18db561e1f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.230624 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693197f-29dc-406d-92f0-18db561e1f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.231473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693197f-29dc-406d-92f0-18db561e1f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:34:09.231797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693197f-29dc-406d-92f0-18db561e1f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:34:09.232844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-4693197f-29dc-406d-92f0-18db561e1f6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:34:09.232844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: warnings.warn(msg) May 12 20:34:09.232844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: May 12 20:34:09.233755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693197f-29dc-406d-92f0-18db561e1f6b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:34:09.245408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 743/1496] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:34:09.254262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572bfb-616d-4716-9c58-be16787a4b31 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:34:09.263482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572bfb-616d-4716-9c58-be16787a4b31 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:34:09.268018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e8afb-5b72-4f0c-888b-d639ea29a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:34:09.268670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e8afb-5b72-4f0c-888b-d639ea29a7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.268957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e8afb-5b72-4f0c-888b-d639ea29a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.269237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e8afb-5b72-4f0c-888b-d639ea29a7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.269949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e8afb-5b72-4f0c-888b-d639ea29a7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:34:09.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: WARNING py.warnings [None req-c30e8afb-5b72-4f0c-888b-d639ea29a7dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:34:09.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: warnings.warn(msg) May 12 20:34:09.271704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: May 12 20:34:09.272906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e8afb-5b72-4f0c-888b-d639ea29a7dd admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:34:09.408131 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 754/1497] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:34:09 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:34:09.412269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693197f-29dc-406d-92f0-18db561e1f6b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:34:09.422825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693197f-29dc-406d-92f0-18db561e1f6b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:34:09.479634 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b33b98-cf46-4040-9014-01f61a682833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:34:09.480807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33b98-cf46-4040-9014-01f61a682833 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.481363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33b98-cf46-4040-9014-01f61a682833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.481851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33b98-cf46-4040-9014-01f61a682833 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.482579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b33b98-cf46-4040-9014-01f61a682833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:34:09.483600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-89b33b98-cf46-4040-9014-01f61a682833 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:34:09.483600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: warnings.warn(msg) May 12 20:34:09.483600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: May 12 20:34:09.495602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b33b98-cf46-4040-9014-01f61a682833 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:34:09.595409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 744/1498] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:34:09 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:34:09.599449 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e8afb-5b72-4f0c-888b-d639ea29a7dd admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:34:09.610150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e8afb-5b72-4f0c-888b-d639ea29a7dd admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:34:09.614927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9862d3b-230f-483e-8068-5a577d210584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:34:09.615689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9862d3b-230f-483e-8068-5a577d210584 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.615972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9862d3b-230f-483e-8068-5a577d210584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.616270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9862d3b-230f-483e-8068-5a577d210584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.616993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9862d3b-230f-483e-8068-5a577d210584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:34:09.618063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: WARNING py.warnings [None req-e9862d3b-230f-483e-8068-5a577d210584 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:34:09.618063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: warnings.warn(msg) May 12 20:34:09.618063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: May 12 20:34:09.619344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9862d3b-230f-483e-8068-5a577d210584 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:34:09.632693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 755/1499] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:34:09.637824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b33b98-cf46-4040-9014-01f61a682833 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:34:09.647627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b33b98-cf46-4040-9014-01f61a682833 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:34:09.653450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fa217-f04f-49bd-942b-f5cb98d31b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:34:09.654112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fa217-f04f-49bd-942b-f5cb98d31b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.654398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fa217-f04f-49bd-942b-f5cb98d31b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.654676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fa217-f04f-49bd-942b-f5cb98d31b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.655431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fa217-f04f-49bd-942b-f5cb98d31b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:34:09.656458 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-159fa217-f04f-49bd-942b-f5cb98d31b2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:34:09.656458 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: warnings.warn(msg) May 12 20:34:09.656458 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: May 12 20:34:09.657389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fa217-f04f-49bd-942b-f5cb98d31b2a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:34:09.671718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 745/1500] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:34:09.675770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9862d3b-230f-483e-8068-5a577d210584 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:34:09.686234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9862d3b-230f-483e-8068-5a577d210584 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:34:09.690810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a9f86-122a-4d0b-8063-fd6bb820e079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:34:09.691677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9f86-122a-4d0b-8063-fd6bb820e079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.691959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9f86-122a-4d0b-8063-fd6bb820e079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.692232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9f86-122a-4d0b-8063-fd6bb820e079 admin admin] PATH_INFO: `/v3/projects/f77040780b4f40e08befe22fae72be9b/users/4bce278a8ffc4cc1aaab575edd1fadd3/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.707238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a9f86-122a-4d0b-8063-fd6bb820e079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77040780b4f40e08befe22fae72be9b, user_id=4bce278a8ffc4cc1aaab575edd1fadd3, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:34:09.708258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: WARNING py.warnings [None req-115a9f86-122a-4d0b-8063-fd6bb820e079 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:34:09.708258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: warnings.warn(msg) May 12 20:34:09.708258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: May 12 20:34:09.710206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a9f86-122a-4d0b-8063-fd6bb820e079 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:34:09.777147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 756/1501] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:34:09 2022] PUT /identity/v3/projects/f77040780b4f40e08befe22fae72be9b/users/4bce278a8ffc4cc1aaab575edd1fadd3/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:34:09.788456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ef82-cead-4fe9-8b7e-1a6790a6b9f4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.788751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ef82-cead-4fe9-8b7e-1a6790a6b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.789031 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57ef82-cead-4fe9-8b7e-1a6790a6b9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.815634 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1b57ef82-cead-4fe9-8b7e-1a6790a6b9f4 None None] MFA Rules not processed for user `4bce278a8ffc4cc1aaab575edd1fadd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:34:09.816883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1b57ef82-cead-4fe9-8b7e-1a6790a6b9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:34:09.886981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 746/1502] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:34:09.902279 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44907c39-fb5c-4e09-9a69-9f5df2f31c31 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.902574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44907c39-fb5c-4e09-9a69-9f5df2f31c31 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.902885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44907c39-fb5c-4e09-9a69-9f5df2f31c31 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.904259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 757/1503] 10.222.0.59 () {54 vars in 963 bytes} [Thu May 12 20:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:34:09.909014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe90b2-bb5b-4411-9ce8-f052d5066853 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:09.909341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe90b2-bb5b-4411-9ce8-f052d5066853 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:09.909629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe90b2-bb5b-4411-9ce8-f052d5066853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:09.928683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1cbe90b2-bb5b-4411-9ce8-f052d5066853 None None] MFA Rules not processed for user `a32db19a943345b6ba1c91e79739835f`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:34:09.929845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1cbe90b2-bb5b-4411-9ce8-f052d5066853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:34:09.977515 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 747/1504] 10.222.0.59 () {58 vars in 1060 bytes} [Thu May 12 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:34:09.985848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44907c39-fb5c-4e09-9a69-9f5df2f31c31 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:34:09.996262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44907c39-fb5c-4e09-9a69-9f5df2f31c31 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:34:09.999991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b17cd-bd42-4b4b-8c04-d3328fbabd87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:34:10.000622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b17cd-bd42-4b4b-8c04-d3328fbabd87 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:10.000908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b17cd-bd42-4b4b-8c04-d3328fbabd87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:10.001189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b17cd-bd42-4b4b-8c04-d3328fbabd87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:10.009413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b17cd-bd42-4b4b-8c04-d3328fbabd87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:34:10.010833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b17cd-bd42-4b4b-8c04-d3328fbabd87 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:34:10.019390 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 758/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:34:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:34:10.062414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f97a-2ab0-4015-89a5-0a6792ae7cbd None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:10.062710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f97a-2ab0-4015-89a5-0a6792ae7cbd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:10.062996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f97a-2ab0-4015-89a5-0a6792ae7cbd None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:10.064315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 748/1506] 10.222.0.59 () {52 vars in 829 bytes} [Thu May 12 20:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:34:10.067830 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b17cd-bd42-4b4b-8c04-d3328fbabd87 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:34:10.138955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b17cd-bd42-4b4b-8c04-d3328fbabd87 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:34:10.143406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:34:10.144279 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:10.144565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:10.144845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] PATH_INFO: `/v3/users/4bce278a8ffc4cc1aaab575edd1fadd3` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:10.146061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bce278a8ffc4cc1aaab575edd1fadd3)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:34:10.147071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: WARNING py.warnings [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:34:10.147071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: warnings.warn(msg) May 12 20:34:10.147071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: May 12 20:34:10.148286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:34:10.339281 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bce278a8ffc4cc1aaab575edd1fadd3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:34:10.339958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bce278a8ffc4cc1aaab575edd1fadd3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:34:10.340639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bce278a8ffc4cc1aaab575edd1fadd3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:34:10.359766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bce278a8ffc4cc1aaab575edd1fadd3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:34:10.371596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bce278a8ffc4cc1aaab575edd1fadd3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:34:10.457165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 759/1507] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:34:10 2022] DELETE /identity/v3/users/4bce278a8ffc4cc1aaab575edd1fadd3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:34:10.461534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517e36-596f-4065-9fd1-ddc569d89796 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:10.462002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517e36-596f-4065-9fd1-ddc569d89796 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:10.462109 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517e36-596f-4065-9fd1-ddc569d89796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:10.479641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fc517e36-596f-4065-9fd1-ddc569d89796 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:34:10.480826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fc517e36-596f-4065-9fd1-ddc569d89796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:34:10.543092 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 749/1508] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:34:10.553984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:34:10.555409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:34:10.612241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76cd38-6f67-4751-9792-41bb80efa63f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:34:10.615866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44b4a8-5555-4919-a5f3-fdac9f039274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:34:10.616515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44b4a8-5555-4919-a5f3-fdac9f039274 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:10.616805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44b4a8-5555-4919-a5f3-fdac9f039274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:10.617086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44b4a8-5555-4919-a5f3-fdac9f039274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:10.626722 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44b4a8-5555-4919-a5f3-fdac9f039274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:34:10.628150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44b4a8-5555-4919-a5f3-fdac9f039274 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:34:10.638040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 760/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:34:11.098389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc517e36-596f-4065-9fd1-ddc569d89796 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:34:11.099818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fc517e36-596f-4065-9fd1-ddc569d89796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:34:11.113436 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc517e36-596f-4065-9fd1-ddc569d89796 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:34:11.117583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:34:11.118467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:34:11.118771 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:34:11.119031 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] PATH_INFO: `/v3/projects/f77040780b4f40e08befe22fae72be9b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:34:11.120255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77040780b4f40e08befe22fae72be9b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:34:11.121265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:34:11.121265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: warnings.warn(msg) May 12 20:34:11.121265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: May 12 20:34:11.122552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:34:11.284982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77040780b4f40e08befe22fae72be9b', 'request_id': 'req-5e00ddaa-5b19-4575-8387-90b010690007'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:34:11.290907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77040780b4f40e08befe22fae72be9b', 'request_id': 'req-5e00ddaa-5b19-4575-8387-90b010690007'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:34:11.365673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77040780b4f40e08befe22fae72be9b', 'request_id': 'req-5e00ddaa-5b19-4575-8387-90b010690007'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:34:11.386120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] The token cache is being invalidate because project f77040780b4f40e08befe22fae72be9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:34:11.386421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:34:11.387052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5e00ddaa-5b19-4575-8387-90b010690007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:34:11.388769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 750/1510] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:34:11 2022] DELETE /identity/v3/projects/f77040780b4f40e08befe22fae72be9b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:35:54.045441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3469be5-1293-4e29-af43-bd40fe127c2c None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:54.046040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3469be5-1293-4e29-af43-bd40fe127c2c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:54.046040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3469be5-1293-4e29-af43-bd40fe127c2c None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:54.047450 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:35:54.052203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff526a-36fb-4bc2-8bd9-768f5334f427 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:54.052641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff526a-36fb-4bc2-8bd9-768f5334f427 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:54.052787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff526a-36fb-4bc2-8bd9-768f5334f427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:54.071065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e6ff526a-36fb-4bc2-8bd9-768f5334f427 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:35:54.072413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e6ff526a-36fb-4bc2-8bd9-768f5334f427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:35:54.129752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:35:54.296607 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3469be5-1293-4e29-af43-bd40fe127c2c None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:35:54.298323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e3469be5-1293-4e29-af43-bd40fe127c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:35:54.374552 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3469be5-1293-4e29-af43-bd40fe127c2c None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:35:54.380165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d59e3-4b76-433e-82fb-3c740bcd3ea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:35:54.380763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d59e3-4b76-433e-82fb-3c740bcd3ea1 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:54.381050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d59e3-4b76-433e-82fb-3c740bcd3ea1 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:54.381364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d59e3-4b76-433e-82fb-3c740bcd3ea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:54.392019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d59e3-4b76-433e-82fb-3c740bcd3ea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:35:54.393676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d59e3-4b76-433e-82fb-3c740bcd3ea1 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:35:54.403437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 762/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:35:54.917153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319e29d-4f34-437c-871f-501a015aaa29 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:54.917482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319e29d-4f34-437c-871f-501a015aaa29 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:54.917769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319e29d-4f34-437c-871f-501a015aaa29 None None] PATH_INFO: `/v3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:54.919081 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 752/1514] 10.222.0.48 () {54 vars in 925 bytes} [Thu May 12 20:35:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:35:54.925386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4a66-9262-46a7-8726-65f8af028219 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:54.925687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4a66-9262-46a7-8726-65f8af028219 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:54.925999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4a66-9262-46a7-8726-65f8af028219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:54.944998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-98ea4a66-9262-46a7-8726-65f8af028219 None None] MFA Rules not processed for user `65431a33849249ed8686d03b0c2e3a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:35:54.946622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-98ea4a66-9262-46a7-8726-65f8af028219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:35:55.018636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 763/1515] 10.222.0.48 () {58 vars in 1015 bytes} [Thu May 12 20:35:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:35:55.308231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b7721-7201-48aa-8775-47376689217f None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:55.308772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b7721-7201-48aa-8775-47376689217f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:55.308772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b7721-7201-48aa-8775-47376689217f None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:55.310276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 753/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 20:35:55.314929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754da5bb-ce97-477c-af9b-8fc309c9ca3d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:55.315411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754da5bb-ce97-477c-af9b-8fc309c9ca3d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:55.315524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754da5bb-ce97-477c-af9b-8fc309c9ca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:55.332944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-754da5bb-ce97-477c-af9b-8fc309c9ca3d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:35:55.334175 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-754da5bb-ce97-477c-af9b-8fc309c9ca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:35:55.342485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 764/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:35:55.494213 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b7721-7201-48aa-8775-47376689217f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:35:55.508598 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b7721-7201-48aa-8775-47376689217f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:35:55.514694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e2188-8c85-4a2f-8600-aa9f6373914b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:35:55.515336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2188-8c85-4a2f-8600-aa9f6373914b service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:55.515629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2188-8c85-4a2f-8600-aa9f6373914b service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:55.515912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2188-8c85-4a2f-8600-aa9f6373914b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:55.523962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e2188-8c85-4a2f-8600-aa9f6373914b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:35:55.526303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e2188-8c85-4a2f-8600-aa9f6373914b service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:35:55.535613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 754/1518] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:35:59.049676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221a5e-1b88-45c8-ae30-f9c22f10061b None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:59.050215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221a5e-1b88-45c8-ae30-f9c22f10061b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:59.050215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221a5e-1b88-45c8-ae30-f9c22f10061b None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:59.051561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 765/1519] 10.222.0.59 () {54 vars in 960 bytes} [Thu May 12 20:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:35:59.056490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776b51a-0ebd-4f77-a889-cc7575fa2adc None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:59.057059 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776b51a-0ebd-4f77-a889-cc7575fa2adc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:59.057059 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776b51a-0ebd-4f77-a889-cc7575fa2adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:59.076272 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a776b51a-0ebd-4f77-a889-cc7575fa2adc None None] MFA Rules not processed for user `65431a33849249ed8686d03b0c2e3a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:35:59.077507 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a776b51a-0ebd-4f77-a889-cc7575fa2adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:35:59.085871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 755/1520] 10.222.0.59 () {58 vars in 1057 bytes} [Thu May 12 20:35:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:35:59.095131 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221a5e-1b88-45c8-ae30-f9c22f10061b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:35:59.109071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221a5e-1b88-45c8-ae30-f9c22f10061b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:35:59.114024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553df14-bee7-484a-aeda-3252e49e33e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:35:59.114662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553df14-bee7-484a-aeda-3252e49e33e6 service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:35:59.114952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553df14-bee7-484a-aeda-3252e49e33e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:35:59.115233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553df14-bee7-484a-aeda-3252e49e33e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:35:59.123997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553df14-bee7-484a-aeda-3252e49e33e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:35:59.125629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553df14-bee7-484a-aeda-3252e49e33e6 service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:35:59.135256 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 766/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:35:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:36:06.847535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47620b03-fde5-4189-a6f1-acbb30eda986 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:06.848154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47620b03-fde5-4189-a6f1-acbb30eda986 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:06.848154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47620b03-fde5-4189-a6f1-acbb30eda986 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:06.849506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:36:06.854575 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725250-6dbe-4238-824c-8327d1b28ac8 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:06.854990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725250-6dbe-4238-824c-8327d1b28ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:06.855145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725250-6dbe-4238-824c-8327d1b28ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:06.873224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8e725250-6dbe-4238-824c-8327d1b28ac8 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:36:06.874709 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8e725250-6dbe-4238-824c-8327d1b28ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:36:06.882391 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:36:07.035666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47620b03-fde5-4189-a6f1-acbb30eda986 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:36:07.049649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47620b03-fde5-4189-a6f1-acbb30eda986 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:36:07.054860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d1084-e346-41a6-aa4a-4fe25cbb4d16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:36:07.055492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d1084-e346-41a6-aa4a-4fe25cbb4d16 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:07.055775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d1084-e346-41a6-aa4a-4fe25cbb4d16 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:07.056052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d1084-e346-41a6-aa4a-4fe25cbb4d16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:07.063886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d1084-e346-41a6-aa4a-4fe25cbb4d16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:36:07.065486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d1084-e346-41a6-aa4a-4fe25cbb4d16 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:36:07.076542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 757/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:36:07.968947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c1aea-c2a8-49fb-aeee-9169c414a74a None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:07.969540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c1aea-c2a8-49fb-aeee-9169c414a74a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:07.969540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c1aea-c2a8-49fb-aeee-9169c414a74a None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:07.970941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 20:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:36:07.975628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a5262-2d39-448d-a090-968072757db6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:07.976055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a5262-2d39-448d-a090-968072757db6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:07.976228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a5262-2d39-448d-a090-968072757db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:07.999897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6e5a5262-2d39-448d-a090-968072757db6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:36:08.001129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6e5a5262-2d39-448d-a090-968072757db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:36:08.008922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 20:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:36:08.159337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c1aea-c2a8-49fb-aeee-9169c414a74a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:36:08.173780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c1aea-c2a8-49fb-aeee-9169c414a74a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:36:08.179135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08912320-c66f-409b-9090-300a4cb44d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:36:08.179771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08912320-c66f-409b-9090-300a4cb44d60 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:08.180060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08912320-c66f-409b-9090-300a4cb44d60 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:08.180340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08912320-c66f-409b-9090-300a4cb44d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:08.188787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08912320-c66f-409b-9090-300a4cb44d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:36:08.190470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08912320-c66f-409b-9090-300a4cb44d60 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:36:08.200418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 769/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:36:12.486419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65591e15-37f4-4a09-91c9-b2d99bf45237 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:12.487012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65591e15-37f4-4a09-91c9-b2d99bf45237 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:12.487012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65591e15-37f4-4a09-91c9-b2d99bf45237 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:12.488371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:36:12.493439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783dc54-09b8-44cd-bfc7-36aaacf92f58 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:12.493845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783dc54-09b8-44cd-bfc7-36aaacf92f58 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:12.494008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783dc54-09b8-44cd-bfc7-36aaacf92f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:12.511727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8783dc54-09b8-44cd-bfc7-36aaacf92f58 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:36:12.512924 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8783dc54-09b8-44cd-bfc7-36aaacf92f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:36:12.520617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:36:12.557363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65591e15-37f4-4a09-91c9-b2d99bf45237 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:36:12.559126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-65591e15-37f4-4a09-91c9-b2d99bf45237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:36:12.613706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65591e15-37f4-4a09-91c9-b2d99bf45237 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:36:12.617230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d8f9b-cac6-4cff-8f45-6f0c013b73ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:36:12.617840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8f9b-cac6-4cff-8f45-6f0c013b73ca service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:12.618124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8f9b-cac6-4cff-8f45-6f0c013b73ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:12.618396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8f9b-cac6-4cff-8f45-6f0c013b73ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:12.627426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d8f9b-cac6-4cff-8f45-6f0c013b73ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:36:12.628866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d8f9b-cac6-4cff-8f45-6f0c013b73ca service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:36:12.638138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 760/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:36:14.899563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfbcf9-0a59-420e-8bca-5122800be3c1 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:14.900118 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfbcf9-0a59-420e-8bca-5122800be3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:14.900118 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfbcf9-0a59-420e-8bca-5122800be3c1 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:14.901844 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:36:14.907158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108d059-ff82-472a-b761-f67cde97c3f9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:14.907586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108d059-ff82-472a-b761-f67cde97c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:14.907730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108d059-ff82-472a-b761-f67cde97c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:14.925603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9108d059-ff82-472a-b761-f67cde97c3f9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:36:14.926830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9108d059-ff82-472a-b761-f67cde97c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:36:14.935600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:36:14.972203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfbcf9-0a59-420e-8bca-5122800be3c1 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:36:14.974003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f9dfbcf9-0a59-420e-8bca-5122800be3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:36:14.987501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfbcf9-0a59-420e-8bca-5122800be3c1 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:36:14.991095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9141c7-f10c-420d-ae34-f19ecfee6afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:36:14.991738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9141c7-f10c-420d-ae34-f19ecfee6afd service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:14.992029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9141c7-f10c-420d-ae34-f19ecfee6afd service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:14.992310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9141c7-f10c-420d-ae34-f19ecfee6afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:15.001937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9141c7-f10c-420d-ae34-f19ecfee6afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:36:15.003366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9141c7-f10c-420d-ae34-f19ecfee6afd service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:36:15.012637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 772/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:36:18.768646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3238-e2cd-4cc4-9fa2-fc0237dea9c6 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:18.769251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3238-e2cd-4cc4-9fa2-fc0237dea9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:18.769251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3238-e2cd-4cc4-9fa2-fc0237dea9c6 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:18.770630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:36:18.776941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a99103-a1b4-46fa-b1a7-0fabcbf60f36 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:18.777385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a99103-a1b4-46fa-b1a7-0fabcbf60f36 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:18.777598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a99103-a1b4-46fa-b1a7-0fabcbf60f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:18.795288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-c1a99103-a1b4-46fa-b1a7-0fabcbf60f36 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:36:18.796508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c1a99103-a1b4-46fa-b1a7-0fabcbf60f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:36:18.804201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:36:19.080373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3238-e2cd-4cc4-9fa2-fc0237dea9c6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:36:19.082058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6caa3238-e2cd-4cc4-9fa2-fc0237dea9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:36:19.138315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3238-e2cd-4cc4-9fa2-fc0237dea9c6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:36:19.142040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca231d5-6033-4e65-a4e3-a2ded4f0228f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:36:19.142692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca231d5-6033-4e65-a4e3-a2ded4f0228f service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:19.142979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca231d5-6033-4e65-a4e3-a2ded4f0228f service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:19.143290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca231d5-6033-4e65-a4e3-a2ded4f0228f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:19.152769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca231d5-6033-4e65-a4e3-a2ded4f0228f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:36:19.154207 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca231d5-6033-4e65-a4e3-a2ded4f0228f service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:36:19.163305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 763/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:36:21.431940 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d0d9a-0929-4c6a-bf91-af9e9e967b36 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:21.432587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d0d9a-0929-4c6a-bf91-af9e9e967b36 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:21.432587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d0d9a-0929-4c6a-bf91-af9e9e967b36 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:21.433922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 20:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:36:21.439210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebd47-fa71-47a1-8f26-a10c1239f871 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:21.439598 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebd47-fa71-47a1-8f26-a10c1239f871 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:21.439828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ebd47-fa71-47a1-8f26-a10c1239f871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:21.457771 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ec3ebd47-fa71-47a1-8f26-a10c1239f871 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:36:21.458952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ec3ebd47-fa71-47a1-8f26-a10c1239f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:36:21.467772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 20:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:36:21.739390 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d0d9a-0929-4c6a-bf91-af9e9e967b36 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:36:21.741032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-cf2d0d9a-0929-4c6a-bf91-af9e9e967b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:36:21.754123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d0d9a-0929-4c6a-bf91-af9e9e967b36 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:36:21.757623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b172bff-10e1-4f45-a1bb-21cf375641ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:36:21.758255 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b172bff-10e1-4f45-a1bb-21cf375641ef service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:36:21.758541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b172bff-10e1-4f45-a1bb-21cf375641ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:36:21.758822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b172bff-10e1-4f45-a1bb-21cf375641ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:36:21.768061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b172bff-10e1-4f45-a1bb-21cf375641ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:36:21.769508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b172bff-10e1-4f45-a1bb-21cf375641ef service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:36:21.779067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 775/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:52.384404 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1ae0d-d308-471d-a009-31a277710038 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.385042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1ae0d-d308-471d-a009-31a277710038 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.385042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1ae0d-d308-471d-a009-31a277710038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.413235 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-78f1ae0d-d308-471d-a009-31a277710038 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.414451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71ec5-1623-416d-8970-ee3131818eb4 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.414955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-78f1ae0d-d308-471d-a009-31a277710038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.415046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71ec5-1623-416d-8970-ee3131818eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.415046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71ec5-1623-416d-8970-ee3131818eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.428357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 765/1540] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:52.444384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51c128-ca01-435c-bf32-e977fab9477b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.444750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51c128-ca01-435c-bf32-e977fab9477b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.444957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51c128-ca01-435c-bf32-e977fab9477b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.445935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-57e71ec5-1623-416d-8970-ee3131818eb4 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.447262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-57e71ec5-1623-416d-8970-ee3131818eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.464924 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 776/1541] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 12 20:37:52.477672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ed66-ddc9-44e2-bf39-413adf7e71c4 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.478019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ed66-ddc9-44e2-bf39-413adf7e71c4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.478243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ed66-ddc9-44e2-bf39-413adf7e71c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.485456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9b51c128-ca01-435c-bf32-e977fab9477b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.486948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9b51c128-ca01-435c-bf32-e977fab9477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.507308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 766/1542] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:37:52.512956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51c128-ca01-435c-bf32-e977fab9477b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:52.514455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-fcd2ed66-ddc9-44e2-bf39-413adf7e71c4 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.515893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-fcd2ed66-ddc9-44e2-bf39-413adf7e71c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.529610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51c128-ca01-435c-bf32-e977fab9477b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:52.532351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 777/1543] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:37:52.533575 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b0c8-c19a-416c-9a79-84b3dd5e772d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.537651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b0c8-c19a-416c-9a79-84b3dd5e772d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.537651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b0c8-c19a-416c-9a79-84b3dd5e772d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.541551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ffa31-3871-4ab0-b970-a746e18863c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:52.542244 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ffa31-3871-4ab0-b970-a746e18863c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.542534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ffa31-3871-4ab0-b970-a746e18863c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.542820 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ffa31-3871-4ab0-b970-a746e18863c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.543602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ffa31-3871-4ab0-b970-a746e18863c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:37:52.543917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ffa31-3871-4ab0-b970-a746e18863c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:52.545549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ffa31-3871-4ab0-b970-a746e18863c8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:52.561752 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-e534b0c8-c19a-416c-9a79-84b3dd5e772d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.565629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e534b0c8-c19a-416c-9a79-84b3dd5e772d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.571961 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 767/1544] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:37:52.571961 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ffa31-3871-4ab0-b970-a746e18863c8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:52.585914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 778/1545] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:52.587279 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb53c-b8ea-478f-a528-fbeebc96d496 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.587575 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb53c-b8ea-478f-a528-fbeebc96d496 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.587857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb53c-b8ea-478f-a528-fbeebc96d496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.599380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ffa31-3871-4ab0-b970-a746e18863c8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:52.613038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce864fca-695d-40a7-8272-885249e9e469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:52.614115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864fca-695d-40a7-8272-885249e9e469 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.614676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864fca-695d-40a7-8272-885249e9e469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.615193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864fca-695d-40a7-8272-885249e9e469 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.616139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce864fca-695d-40a7-8272-885249e9e469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:37:52.616667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce864fca-695d-40a7-8272-885249e9e469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:52.618986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce864fca-695d-40a7-8272-885249e9e469 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:52.623761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-460cb53c-b8ea-478f-a528-fbeebc96d496 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.623761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-460cb53c-b8ea-478f-a528-fbeebc96d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.643253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 779/1546] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:52.643253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb53c-b8ea-478f-a528-fbeebc96d496 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:52.650110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 768/1547] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:37:52.651435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9751657-baee-4922-8969-df3520a599f5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.651724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9751657-baee-4922-8969-df3520a599f5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.652003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9751657-baee-4922-8969-df3520a599f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.658284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb53c-b8ea-478f-a528-fbeebc96d496 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:52.662978 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7b3eb-b1e2-4b7b-909e-0f6e69c3ad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:52.663706 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7b3eb-b1e2-4b7b-909e-0f6e69c3ad79 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.663992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7b3eb-b1e2-4b7b-909e-0f6e69c3ad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.664303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7b3eb-b1e2-4b7b-909e-0f6e69c3ad79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.665137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7b3eb-b1e2-4b7b-909e-0f6e69c3ad79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:52.667217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7b3eb-b1e2-4b7b-909e-0f6e69c3ad79 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:52.674306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b9751657-baee-4922-8969-df3520a599f5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.675525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b9751657-baee-4922-8969-df3520a599f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.684939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 769/1548] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:52.695281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07a8f-dab6-45f4-89d8-534263cd90a9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.695281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07a8f-dab6-45f4-89d8-534263cd90a9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.695281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07a8f-dab6-45f4-89d8-534263cd90a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.703996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-68b07a8f-dab6-45f4-89d8-534263cd90a9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.705175 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-68b07a8f-dab6-45f4-89d8-534263cd90a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.712982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 770/1549] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:52.715121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9fea7-1c1f-44da-89e5-098411d85a72 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.715121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9fea7-1c1f-44da-89e5-098411d85a72 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.715121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9fea7-1c1f-44da-89e5-098411d85a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.732522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c4a9fea7-1c1f-44da-89e5-098411d85a72 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.733744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c4a9fea7-1c1f-44da-89e5-098411d85a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.741489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 771/1550] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:52.743856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08514c37-ce40-4299-86d5-e53bd38b23e9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.743856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08514c37-ce40-4299-86d5-e53bd38b23e9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.743856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08514c37-ce40-4299-86d5-e53bd38b23e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.761713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-08514c37-ce40-4299-86d5-e53bd38b23e9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.763769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-08514c37-ce40-4299-86d5-e53bd38b23e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.771503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 772/1551] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:52.772242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08514c37-ce40-4299-86d5-e53bd38b23e9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:52.781999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08514c37-ce40-4299-86d5-e53bd38b23e9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:52.786560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b7ba3-b0ed-4356-9fa2-2214633dba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:52.787199 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b7ba3-b0ed-4356-9fa2-2214633dba69 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.787483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b7ba3-b0ed-4356-9fa2-2214633dba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.787843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b7ba3-b0ed-4356-9fa2-2214633dba69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.788536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b7ba3-b0ed-4356-9fa2-2214633dba69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:52.789599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-1f4b7ba3-b0ed-4356-9fa2-2214633dba69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:37:52.789599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: warnings.warn(msg) May 12 20:37:52.789599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: May 12 20:37:52.790821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b7ba3-b0ed-4356-9fa2-2214633dba69 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:52.833260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 780/1552] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:52.834621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6276e-f99b-460c-bf93-810661988d70 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.834915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6276e-f99b-460c-bf93-810661988d70 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.835238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6276e-f99b-460c-bf93-810661988d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.852480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-bde6276e-f99b-460c-bf93-810661988d70 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:52.853714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bde6276e-f99b-460c-bf93-810661988d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:52.907226 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 773/1553] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:52.908748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904f5c-4a72-40b5-be2a-82d295090033 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.909227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904f5c-4a72-40b5-be2a-82d295090033 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.909687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904f5c-4a72-40b5-be2a-82d295090033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.912658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 781/1554] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:52.913577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6276e-f99b-460c-bf93-810661988d70 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:52.924187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6276e-f99b-460c-bf93-810661988d70 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:52.985029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889348fa-d05c-437c-941b-e18bfc00a372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:52.985755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889348fa-d05c-437c-941b-e18bfc00a372 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:52.986045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889348fa-d05c-437c-941b-e18bfc00a372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:52.986325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889348fa-d05c-437c-941b-e18bfc00a372 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:52.987072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889348fa-d05c-437c-941b-e18bfc00a372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:37:52.987385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889348fa-d05c-437c-941b-e18bfc00a372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:52.988431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: WARNING py.warnings [None req-889348fa-d05c-437c-941b-e18bfc00a372 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:37:52.988431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: warnings.warn(msg) May 12 20:37:52.988431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: May 12 20:37:52.989375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889348fa-d05c-437c-941b-e18bfc00a372 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.003218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 782/1555] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:37:53.004678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813953e-36a9-4963-9b6f-fa3f7a533cf3 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.004975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813953e-36a9-4963-9b6f-fa3f7a533cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.005266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813953e-36a9-4963-9b6f-fa3f7a533cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.024351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-0813953e-36a9-4963-9b6f-fa3f7a533cf3 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:53.025629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0813953e-36a9-4963-9b6f-fa3f7a533cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:53.034124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 783/1556] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:53.034972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813953e-36a9-4963-9b6f-fa3f7a533cf3 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.047707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813953e-36a9-4963-9b6f-fa3f7a533cf3 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.052329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1abfc3-ccac-4f01-8f76-1711e37bec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.053000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1abfc3-ccac-4f01-8f76-1711e37bec81 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.053392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1abfc3-ccac-4f01-8f76-1711e37bec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.053588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1abfc3-ccac-4f01-8f76-1711e37bec81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.054353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1abfc3-ccac-4f01-8f76-1711e37bec81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:37:53.054663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1abfc3-ccac-4f01-8f76-1711e37bec81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.056263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1abfc3-ccac-4f01-8f76-1711e37bec81 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.059033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-53904f5c-4a72-40b5-be2a-82d295090033 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:53.060824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-53904f5c-4a72-40b5-be2a-82d295090033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:53.067666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 784/1557] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:37:53.076844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 774/1558] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:53.077048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5842ead-03ca-41a6-814d-85ea1d5c2674 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.077048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5842ead-03ca-41a6-814d-85ea1d5c2674 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.077048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5842ead-03ca-41a6-814d-85ea1d5c2674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.077379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904f5c-4a72-40b5-be2a-82d295090033 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.084454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904f5c-4a72-40b5-be2a-82d295090033 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.086751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f5842ead-03ca-41a6-814d-85ea1d5c2674 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:53.087962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f5842ead-03ca-41a6-814d-85ea1d5c2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:53.089217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30248-548d-43d9-8c10-35b1c0535a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.089905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30248-548d-43d9-8c10-35b1c0535a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.090185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30248-548d-43d9-8c10-35b1c0535a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.090974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30248-548d-43d9-8c10-35b1c0535a8d admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.092102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30248-548d-43d9-8c10-35b1c0535a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.094040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30248-548d-43d9-8c10-35b1c0535a8d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.097091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 785/1559] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:53.097883 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5842ead-03ca-41a6-814d-85ea1d5c2674 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.107902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5842ead-03ca-41a6-814d-85ea1d5c2674 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.112415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e696b-7b41-4369-a050-74aea0dd12eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.118952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e696b-7b41-4369-a050-74aea0dd12eb admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.118952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e696b-7b41-4369-a050-74aea0dd12eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.118952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e696b-7b41-4369-a050-74aea0dd12eb admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.118952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e696b-7b41-4369-a050-74aea0dd12eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.118952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: WARNING py.warnings [None req-522e696b-7b41-4369-a050-74aea0dd12eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:37:53.118952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: warnings.warn(msg) May 12 20:37:53.118952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: May 12 20:37:53.119563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e696b-7b41-4369-a050-74aea0dd12eb admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.225085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 775/1560] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:53.226341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9df8-9c30-4da5-b6dd-3ea0b73c80b8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.226659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9df8-9c30-4da5-b6dd-3ea0b73c80b8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.226921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9df8-9c30-4da5-b6dd-3ea0b73c80b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.234672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 786/1561] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:53.235689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e696b-7b41-4369-a050-74aea0dd12eb admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.245028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e696b-7b41-4369-a050-74aea0dd12eb admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.247625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-800d9df8-9c30-4da5-b6dd-3ea0b73c80b8 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:53.247625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-800d9df8-9c30-4da5-b6dd-3ea0b73c80b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:53.250455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458fd52-6a1c-4880-b10d-52c4c391fa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.251366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458fd52-6a1c-4880-b10d-52c4c391fa17 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.251653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458fd52-6a1c-4880-b10d-52c4c391fa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.251939 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458fd52-6a1c-4880-b10d-52c4c391fa17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.252636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458fd52-6a1c-4880-b10d-52c4c391fa17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.254567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458fd52-6a1c-4880-b10d-52c4c391fa17 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.256143 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 776/1562] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:53.256902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9df8-9c30-4da5-b6dd-3ea0b73c80b8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.266919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9df8-9c30-4da5-b6dd-3ea0b73c80b8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.271401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322686-b2bd-4f12-9a09-f18288813e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.272099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322686-b2bd-4f12-9a09-f18288813e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.272404 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322686-b2bd-4f12-9a09-f18288813e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.272679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322686-b2bd-4f12-9a09-f18288813e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.273554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b322686-b2bd-4f12-9a09-f18288813e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:37:53.273860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b322686-b2bd-4f12-9a09-f18288813e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.275426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b322686-b2bd-4f12-9a09-f18288813e1d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.291061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 777/1563] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:37:53.292013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322686-b2bd-4f12-9a09-f18288813e1d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.302257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322686-b2bd-4f12-9a09-f18288813e1d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.306709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b019de2-a84a-4ea6-a189-902a46943792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.307333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b019de2-a84a-4ea6-a189-902a46943792 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.307615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b019de2-a84a-4ea6-a189-902a46943792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.307891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b019de2-a84a-4ea6-a189-902a46943792 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.308562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b019de2-a84a-4ea6-a189-902a46943792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.311218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b019de2-a84a-4ea6-a189-902a46943792 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.381338 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 787/1564] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/projects => generated 409 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:53.382729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278e286-7000-47f2-a5cb-2d4611d10679 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.383034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278e286-7000-47f2-a5cb-2d4611d10679 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.383316 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278e286-7000-47f2-a5cb-2d4611d10679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.400903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-0278e286-7000-47f2-a5cb-2d4611d10679 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:53.402138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0278e286-7000-47f2-a5cb-2d4611d10679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:53.421464 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 778/1565] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:53.422299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b019de2-a84a-4ea6-a189-902a46943792 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.461164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 788/1566] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:53.462754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278e286-7000-47f2-a5cb-2d4611d10679 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.472764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278e286-7000-47f2-a5cb-2d4611d10679 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.491909 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b019de2-a84a-4ea6-a189-902a46943792 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.494072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825907d-5af3-4c1f-96f1-1038171201cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.494735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825907d-5af3-4c1f-96f1-1038171201cb admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.495016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825907d-5af3-4c1f-96f1-1038171201cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.495296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825907d-5af3-4c1f-96f1-1038171201cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.496023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825907d-5af3-4c1f-96f1-1038171201cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:37:53.496327 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825907d-5af3-4c1f-96f1-1038171201cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.498212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825907d-5af3-4c1f-96f1-1038171201cb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.529222 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40b6e1-7363-4ade-bc80-e5c91e11e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.529917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40b6e1-7363-4ade-bc80-e5c91e11e9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.530199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40b6e1-7363-4ade-bc80-e5c91e11e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.530473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40b6e1-7363-4ade-bc80-e5c91e11e9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.531256 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40b6e1-7363-4ade-bc80-e5c91e11e9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.532853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40b6e1-7363-4ade-bc80-e5c91e11e9c8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.540584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 779/1567] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:37:53.541450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825907d-5af3-4c1f-96f1-1038171201cb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.546055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 789/1568] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:53.546055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40b6e1-7363-4ade-bc80-e5c91e11e9c8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.552865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825907d-5af3-4c1f-96f1-1038171201cb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.554043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40b6e1-7363-4ade-bc80-e5c91e11e9c8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.557456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba783344-d621-4a03-aabc-7f730048f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.558120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783344-d621-4a03-aabc-7f730048f6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.558406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783344-d621-4a03-aabc-7f730048f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.558506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de56719-66ab-40cb-857c-4c43864a3c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.558688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783344-d621-4a03-aabc-7f730048f6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.559257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56719-66ab-40cb-857c-4c43864a3c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.559469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba783344-d621-4a03-aabc-7f730048f6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.559568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56719-66ab-40cb-857c-4c43864a3c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.559804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56719-66ab-40cb-857c-4c43864a3c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.560524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de56719-66ab-40cb-857c-4c43864a3c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:37:53.560831 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de56719-66ab-40cb-857c-4c43864a3c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.561252 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba783344-d621-4a03-aabc-7f730048f6d5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.562480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de56719-66ab-40cb-857c-4c43864a3c68 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.570905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 780/1569] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:53.571688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba783344-d621-4a03-aabc-7f730048f6d5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.575414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 790/1570] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:37:53.576257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de56719-66ab-40cb-857c-4c43864a3c68 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.581191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba783344-d621-4a03-aabc-7f730048f6d5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.585826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b94b8-2ed7-4e55-a3c8-9326c799024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.586466 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b94b8-2ed7-4e55-a3c8-9326c799024b admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.586782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b94b8-2ed7-4e55-a3c8-9326c799024b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.587061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b94b8-2ed7-4e55-a3c8-9326c799024b admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.587741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b94b8-2ed7-4e55-a3c8-9326c799024b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.589654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b94b8-2ed7-4e55-a3c8-9326c799024b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.592439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de56719-66ab-40cb-857c-4c43864a3c68 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.597051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f9e98-224c-43f8-9308-73f260042569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.597737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f9e98-224c-43f8-9308-73f260042569 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.598027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f9e98-224c-43f8-9308-73f260042569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.598304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f9e98-224c-43f8-9308-73f260042569 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.598991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f9e98-224c-43f8-9308-73f260042569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.600896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f9e98-224c-43f8-9308-73f260042569 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.695066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 781/1571] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:53.696006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b94b8-2ed7-4e55-a3c8-9326c799024b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.742581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 791/1572] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/users => generated 305 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:53.742581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f9e98-224c-43f8-9308-73f260042569 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.750885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f9e98-224c-43f8-9308-73f260042569 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.755198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b94b8-2ed7-4e55-a3c8-9326c799024b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.755897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a8b5-bad4-44b1-bdaf-f1c9a9792fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.756551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a8b5-bad4-44b1-bdaf-f1c9a9792fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.756845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a8b5-bad4-44b1-bdaf-f1c9a9792fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.757125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a8b5-bad4-44b1-bdaf-f1c9a9792fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.757885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49a8b5-bad4-44b1-bdaf-f1c9a9792fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:37:53.758198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49a8b5-bad4-44b1-bdaf-f1c9a9792fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.759774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49a8b5-bad4-44b1-bdaf-f1c9a9792fa1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.760020 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f0a97-b0d9-45e9-8f7e-86c0eac6423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.760724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f0a97-b0d9-45e9-8f7e-86c0eac6423c admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.761026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f0a97-b0d9-45e9-8f7e-86c0eac6423c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.761380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f0a97-b0d9-45e9-8f7e-86c0eac6423c admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.762087 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f0a97-b0d9-45e9-8f7e-86c0eac6423c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.765146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f0a97-b0d9-45e9-8f7e-86c0eac6423c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.772600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 792/1573] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:37:53.773377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a8b5-bad4-44b1-bdaf-f1c9a9792fa1 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.783154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a8b5-bad4-44b1-bdaf-f1c9a9792fa1 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.787747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef188474-e842-42a5-b22a-c019b764878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.789904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef188474-e842-42a5-b22a-c019b764878a admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.789904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef188474-e842-42a5-b22a-c019b764878a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.789904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef188474-e842-42a5-b22a-c019b764878a admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.789904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef188474-e842-42a5-b22a-c019b764878a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.791422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef188474-e842-42a5-b22a-c019b764878a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.801559 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 793/1574] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:53.802330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef188474-e842-42a5-b22a-c019b764878a admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.812276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef188474-e842-42a5-b22a-c019b764878a admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.816788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01739130-91a9-455d-81a5-e058ae78f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.817437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01739130-91a9-455d-81a5-e058ae78f576 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.817729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01739130-91a9-455d-81a5-e058ae78f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.818012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01739130-91a9-455d-81a5-e058ae78f576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.818683 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01739130-91a9-455d-81a5-e058ae78f576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.820520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01739130-91a9-455d-81a5-e058ae78f576 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.853819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 782/1575] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:53.854664 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f0a97-b0d9-45e9-8f7e-86c0eac6423c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.865267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f0a97-b0d9-45e9-8f7e-86c0eac6423c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.872951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44db9-1d0e-4115-8ad7-9c6e1372f308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.873653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44db9-1d0e-4115-8ad7-9c6e1372f308 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.873929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44db9-1d0e-4115-8ad7-9c6e1372f308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.874198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44db9-1d0e-4115-8ad7-9c6e1372f308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.874926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44db9-1d0e-4115-8ad7-9c6e1372f308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.876889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44db9-1d0e-4115-8ad7-9c6e1372f308 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.886690 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 783/1576] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:53.887596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44db9-1d0e-4115-8ad7-9c6e1372f308 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.896670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44db9-1d0e-4115-8ad7-9c6e1372f308 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.901048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d9712-f674-4106-a7d3-0f1c7d9206f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.902905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d9712-f674-4106-a7d3-0f1c7d9206f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.902905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d9712-f674-4106-a7d3-0f1c7d9206f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.902905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d9712-f674-4106-a7d3-0f1c7d9206f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.903706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d9712-f674-4106-a7d3-0f1c7d9206f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.904866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d9712-f674-4106-a7d3-0f1c7d9206f1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:53.929342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 794/1577] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:53.930231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01739130-91a9-455d-81a5-e058ae78f576 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:53.988755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01739130-91a9-455d-81a5-e058ae78f576 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:53.994742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8731d31-58c3-4eeb-a3f0-20d45517a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:53.994742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8731d31-58c3-4eeb-a3f0-20d45517a602 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:53.994742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8731d31-58c3-4eeb-a3f0-20d45517a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:53.994742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8731d31-58c3-4eeb-a3f0-20d45517a602 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:53.995366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8731d31-58c3-4eeb-a3f0-20d45517a602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:53.998146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8731d31-58c3-4eeb-a3f0-20d45517a602 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.000067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 784/1578] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:54.001250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d9712-f674-4106-a7d3-0f1c7d9206f1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.064115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d9712-f674-4106-a7d3-0f1c7d9206f1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.068741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455def0-2b3e-47e5-a779-d9485615971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.069449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455def0-2b3e-47e5-a779-d9485615971b admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.069738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455def0-2b3e-47e5-a779-d9485615971b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.070017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455def0-2b3e-47e5-a779-d9485615971b admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.070775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455def0-2b3e-47e5-a779-d9485615971b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.071233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 795/1579] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:53 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:54.071928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8731d31-58c3-4eeb-a3f0-20d45517a602 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.072519 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455def0-2b3e-47e5-a779-d9485615971b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.082913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 785/1580] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:54.083272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8731d31-58c3-4eeb-a3f0-20d45517a602 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.083838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455def0-2b3e-47e5-a779-d9485615971b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.088177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1738-b231-48c7-9296-83b333b4f308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.088969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1738-b231-48c7-9296-83b333b4f308 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.089153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1738-b231-48c7-9296-83b333b4f308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.089478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1738-b231-48c7-9296-83b333b4f308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.090179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a1738-b231-48c7-9296-83b333b4f308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.092292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a1738-b231-48c7-9296-83b333b4f308 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.093870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455def0-2b3e-47e5-a779-d9485615971b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.098488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562ec85-6976-435b-82e4-41aa60a2460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.099366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562ec85-6976-435b-82e4-41aa60a2460a admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.099656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562ec85-6976-435b-82e4-41aa60a2460a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.099939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562ec85-6976-435b-82e4-41aa60a2460a admin admin] PATH_INFO: `/v3/projects/e3bcc803e53f46efb996577417eca77a/users/64ce721d7163430dbf31ffbbf28c2094/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.115023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562ec85-6976-435b-82e4-41aa60a2460a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcc803e53f46efb996577417eca77a, user_id=64ce721d7163430dbf31ffbbf28c2094, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.116093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-d562ec85-6976-435b-82e4-41aa60a2460a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:37:54.116093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: warnings.warn(msg) May 12 20:37:54.116093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: May 12 20:37:54.118071 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562ec85-6976-435b-82e4-41aa60a2460a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.196517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 796/1581] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:54 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:54.196517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1738-b231-48c7-9296-83b333b4f308 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.225749 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 786/1582] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:54 2022] PUT /identity/v3/projects/e3bcc803e53f46efb996577417eca77a/users/64ce721d7163430dbf31ffbbf28c2094/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:54.230997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562ec85-6976-435b-82e4-41aa60a2460a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.255437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1738-b231-48c7-9296-83b333b4f308 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.287952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562ec85-6976-435b-82e4-41aa60a2460a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.292511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9040f9-887f-488d-aa93-2585f48b728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.293430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9040f9-887f-488d-aa93-2585f48b728f admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.293724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9040f9-887f-488d-aa93-2585f48b728f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.294684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9040f9-887f-488d-aa93-2585f48b728f admin admin] PATH_INFO: `/v3/projects/1ca3db22ad6a4c14a5e86696a8cb43f9/users/0034ea4df67849d193d6fabca6395773/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.308578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9040f9-887f-488d-aa93-2585f48b728f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca3db22ad6a4c14a5e86696a8cb43f9, user_id=0034ea4df67849d193d6fabca6395773, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.309757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33767a-e4d0-47fb-ad1d-e344a2ebcb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.310448 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33767a-e4d0-47fb-ad1d-e344a2ebcb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.310735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33767a-e4d0-47fb-ad1d-e344a2ebcb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.311019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33767a-e4d0-47fb-ad1d-e344a2ebcb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.311516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9040f9-887f-488d-aa93-2585f48b728f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.311749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33767a-e4d0-47fb-ad1d-e344a2ebcb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.313365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33767a-e4d0-47fb-ad1d-e344a2ebcb79 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.323067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 797/1583] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:54.328314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33767a-e4d0-47fb-ad1d-e344a2ebcb79 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.333177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33767a-e4d0-47fb-ad1d-e344a2ebcb79 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.337742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b5b91-da2c-49ad-90bb-34356eb4a5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.338370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b5b91-da2c-49ad-90bb-34356eb4a5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.338660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b5b91-da2c-49ad-90bb-34356eb4a5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.338943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b5b91-da2c-49ad-90bb-34356eb4a5c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.339612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b5b91-da2c-49ad-90bb-34356eb4a5c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.342303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b5b91-da2c-49ad-90bb-34356eb4a5c1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.396871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 787/1584] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:54 2022] PUT /identity/v3/projects/1ca3db22ad6a4c14a5e86696a8cb43f9/users/0034ea4df67849d193d6fabca6395773/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:54.397715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9040f9-887f-488d-aa93-2585f48b728f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.420269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 798/1585] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:54 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:54.425905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b5b91-da2c-49ad-90bb-34356eb4a5c1 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.432766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b5b91-da2c-49ad-90bb-34356eb4a5c1 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.459568 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9040f9-887f-488d-aa93-2585f48b728f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.464741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ac1bf-56cd-43e4-92f9-6700277265e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.465470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ac1bf-56cd-43e4-92f9-6700277265e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.466306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ac1bf-56cd-43e4-92f9-6700277265e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.466797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ac1bf-56cd-43e4-92f9-6700277265e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.467378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ac1bf-56cd-43e4-92f9-6700277265e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.469329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ac1bf-56cd-43e4-92f9-6700277265e6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.488717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d85b3f-d685-408f-88b9-c359ded57feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.489425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d85b3f-d685-408f-88b9-c359ded57feb admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.489708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d85b3f-d685-408f-88b9-c359ded57feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.489983 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d85b3f-d685-408f-88b9-c359ded57feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.490701 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d85b3f-d685-408f-88b9-c359ded57feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.492323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d85b3f-d685-408f-88b9-c359ded57feb admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.502159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 799/1586] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:54.502936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d85b3f-d685-408f-88b9-c359ded57feb admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.512262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d85b3f-d685-408f-88b9-c359ded57feb admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.516851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e2d33-89a7-482d-b650-7d344edf906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.517526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2d33-89a7-482d-b650-7d344edf906b admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.517816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2d33-89a7-482d-b650-7d344edf906b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.518099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2d33-89a7-482d-b650-7d344edf906b admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.518804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e2d33-89a7-482d-b650-7d344edf906b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.520350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e2d33-89a7-482d-b650-7d344edf906b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.530609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 800/1587] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:54.531359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e2d33-89a7-482d-b650-7d344edf906b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.540542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e2d33-89a7-482d-b650-7d344edf906b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.545980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c359d-7ca5-4aa8-bc46-13a1a7e19a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.546606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c359d-7ca5-4aa8-bc46-13a1a7e19a1b admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.546893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c359d-7ca5-4aa8-bc46-13a1a7e19a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.547179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c359d-7ca5-4aa8-bc46-13a1a7e19a1b admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.547852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c359d-7ca5-4aa8-bc46-13a1a7e19a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.549842 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c359d-7ca5-4aa8-bc46-13a1a7e19a1b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.559714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 788/1588] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:54 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:54.559714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fc3e-9d03-4baa-92e4-88dc35d470ec None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.559714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fc3e-9d03-4baa-92e4-88dc35d470ec None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.559714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fc3e-9d03-4baa-92e4-88dc35d470ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.575985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6db4fc3e-9d03-4baa-92e4-88dc35d470ec None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:54.578699 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6db4fc3e-9d03-4baa-92e4-88dc35d470ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:54.585037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 789/1589] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:54.585992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fc3e-9d03-4baa-92e4-88dc35d470ec None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.596341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fc3e-9d03-4baa-92e4-88dc35d470ec None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.600868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c36be-3219-4d67-88e6-0b9fd75aeb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.601567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c36be-3219-4d67-88e6-0b9fd75aeb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.601890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c36be-3219-4d67-88e6-0b9fd75aeb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.602168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c36be-3219-4d67-88e6-0b9fd75aeb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.602896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c36be-3219-4d67-88e6-0b9fd75aeb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.604477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c36be-3219-4d67-88e6-0b9fd75aeb6e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.615056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 790/1590] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:54.616429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371158de-3bcf-4254-8390-9cbe390a4626 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.616721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371158de-3bcf-4254-8390-9cbe390a4626 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.617000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371158de-3bcf-4254-8390-9cbe390a4626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.631626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 801/1591] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:54 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:54.632475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c359d-7ca5-4aa8-bc46-13a1a7e19a1b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.635419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-371158de-3bcf-4254-8390-9cbe390a4626 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:54.636636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-371158de-3bcf-4254-8390-9cbe390a4626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:54.644051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c359d-7ca5-4aa8-bc46-13a1a7e19a1b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.644845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 791/1592] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:54.654046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371158de-3bcf-4254-8390-9cbe390a4626 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.654295 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c1850-1291-4b6a-b1af-0d3adc389a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.654471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c1850-1291-4b6a-b1af-0d3adc389a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.654889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c1850-1291-4b6a-b1af-0d3adc389a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.655248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c1850-1291-4b6a-b1af-0d3adc389a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.655934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371158de-3bcf-4254-8390-9cbe390a4626 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.656282 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c1850-1291-4b6a-b1af-0d3adc389a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.658046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c1850-1291-4b6a-b1af-0d3adc389a7d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.660478 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200cb1c-4ac3-49fa-997f-2b75eae90702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.661136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200cb1c-4ac3-49fa-997f-2b75eae90702 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.661532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200cb1c-4ac3-49fa-997f-2b75eae90702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.661828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200cb1c-4ac3-49fa-997f-2b75eae90702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.662567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200cb1c-4ac3-49fa-997f-2b75eae90702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.664260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200cb1c-4ac3-49fa-997f-2b75eae90702 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.668828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 802/1593] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:54.669753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c1850-1291-4b6a-b1af-0d3adc389a7d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.678001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 792/1594] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:54.678001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200cb1c-4ac3-49fa-997f-2b75eae90702 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.681463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c1850-1291-4b6a-b1af-0d3adc389a7d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.685668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200cb1c-4ac3-49fa-997f-2b75eae90702 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.687695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a3dcd-478d-4595-808b-227c9b34db47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.687695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a3dcd-478d-4595-808b-227c9b34db47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.687695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a3dcd-478d-4595-808b-227c9b34db47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.688084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a3dcd-478d-4595-808b-227c9b34db47 admin admin] PATH_INFO: `/v3/projects/3d2fc72d0ed540d3adcc66f456b0f5f6/users/c1a3d3e7ddef4a4fb859c52ceecb1b1e/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.690433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d720b-cc9c-4303-ad54-2d8cb5a64359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.691085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d720b-cc9c-4303-ad54-2d8cb5a64359 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.691372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d720b-cc9c-4303-ad54-2d8cb5a64359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.691651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d720b-cc9c-4303-ad54-2d8cb5a64359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.692424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d720b-cc9c-4303-ad54-2d8cb5a64359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.694169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d720b-cc9c-4303-ad54-2d8cb5a64359 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.703119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a3dcd-478d-4595-808b-227c9b34db47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2fc72d0ed540d3adcc66f456b0f5f6, user_id=c1a3d3e7ddef4a4fb859c52ceecb1b1e, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.704702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 793/1595] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:54.705546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d720b-cc9c-4303-ad54-2d8cb5a64359 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.705797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a3dcd-478d-4595-808b-227c9b34db47 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.758102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d720b-cc9c-4303-ad54-2d8cb5a64359 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.761732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df70aa4-3037-42d3-a208-fb9118e86786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.762430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df70aa4-3037-42d3-a208-fb9118e86786 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.763275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df70aa4-3037-42d3-a208-fb9118e86786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.763528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df70aa4-3037-42d3-a208-fb9118e86786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.772300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df70aa4-3037-42d3-a208-fb9118e86786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.773750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df70aa4-3037-42d3-a208-fb9118e86786 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.784349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 794/1596] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:54.785111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df70aa4-3037-42d3-a208-fb9118e86786 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.795542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df70aa4-3037-42d3-a208-fb9118e86786 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.800250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b288bd-fcba-4e76-abeb-cefc078df94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.801126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b288bd-fcba-4e76-abeb-cefc078df94d admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.801456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b288bd-fcba-4e76-abeb-cefc078df94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.801743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b288bd-fcba-4e76-abeb-cefc078df94d admin admin] PATH_INFO: `/v3/projects/7dc9e80addbc4f50b0f5fd2f33d9c243/users/ff746db0f04a408f9b3893e98b553ad2/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.816784 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b288bd-fcba-4e76-abeb-cefc078df94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc9e80addbc4f50b0f5fd2f33d9c243, user_id=ff746db0f04a408f9b3893e98b553ad2, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.819471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b288bd-fcba-4e76-abeb-cefc078df94d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.835904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 803/1597] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:54 2022] PUT /identity/v3/projects/3d2fc72d0ed540d3adcc66f456b0f5f6/users/c1a3d3e7ddef4a4fb859c52ceecb1b1e/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:54.836971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a3dcd-478d-4595-808b-227c9b34db47 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.898340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a3dcd-478d-4595-808b-227c9b34db47 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.903301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872de356-7475-4f66-8fb7-00ac5a679dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.904318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872de356-7475-4f66-8fb7-00ac5a679dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.904588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872de356-7475-4f66-8fb7-00ac5a679dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.904875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872de356-7475-4f66-8fb7-00ac5a679dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:54.905653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872de356-7475-4f66-8fb7-00ac5a679dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:54.907301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872de356-7475-4f66-8fb7-00ac5a679dbd admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:54.924989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 795/1598] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:54 2022] PUT /identity/v3/projects/7dc9e80addbc4f50b0f5fd2f33d9c243/users/ff746db0f04a408f9b3893e98b553ad2/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:54.924989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b288bd-fcba-4e76-abeb-cefc078df94d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.925334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 804/1599] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:54.925334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872de356-7475-4f66-8fb7-00ac5a679dbd admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:54.940022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872de356-7475-4f66-8fb7-00ac5a679dbd admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.986304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b288bd-fcba-4e76-abeb-cefc078df94d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:54.990094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93dd7-b20c-4f1d-ab18-e66c9d422377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:54.990750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93dd7-b20c-4f1d-ab18-e66c9d422377 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:54.991038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93dd7-b20c-4f1d-ab18-e66c9d422377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:54.991318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93dd7-b20c-4f1d-ab18-e66c9d422377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.002223 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0a1ca-a6aa-4d5b-8515-1bf092c85d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.002900 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0a1ca-a6aa-4d5b-8515-1bf092c85d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.003194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0a1ca-a6aa-4d5b-8515-1bf092c85d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.003506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0a1ca-a6aa-4d5b-8515-1bf092c85d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.004240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0a1ca-a6aa-4d5b-8515-1bf092c85d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.005894 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0a1ca-a6aa-4d5b-8515-1bf092c85d28 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.017371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 805/1600] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:55.017371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0a1ca-a6aa-4d5b-8515-1bf092c85d28 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:55.026785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0a1ca-a6aa-4d5b-8515-1bf092c85d28 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:55.032057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841da4b4-668d-489e-9ce3-75fa88279c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.032965 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841da4b4-668d-489e-9ce3-75fa88279c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.033256 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841da4b4-668d-489e-9ce3-75fa88279c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.033586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841da4b4-668d-489e-9ce3-75fa88279c64 admin admin] PATH_INFO: `/v3/projects/bec19c8306c6439b9392248450d21ec9/users/606b53c6f60d45cf9e2c3e5c6c9cde2e/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.048741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841da4b4-668d-489e-9ce3-75fa88279c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec19c8306c6439b9392248450d21ec9, user_id=606b53c6f60d45cf9e2c3e5c6c9cde2e, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.051606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841da4b4-668d-489e-9ce3-75fa88279c64 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.055912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d93dd7-b20c-4f1d-ab18-e66c9d422377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.057373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d93dd7-b20c-4f1d-ab18-e66c9d422377 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.066819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 796/1601] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:55.068800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93dd7-b20c-4f1d-ab18-e66c9d422377 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:55.077975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93dd7-b20c-4f1d-ab18-e66c9d422377 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:55.082590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d193b-7a74-4325-937c-0ed379e8514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.083255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d193b-7a74-4325-937c-0ed379e8514c admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.083545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d193b-7a74-4325-937c-0ed379e8514c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.083824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d193b-7a74-4325-937c-0ed379e8514c admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.084549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d193b-7a74-4325-937c-0ed379e8514c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.086247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d193b-7a74-4325-937c-0ed379e8514c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.097657 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 797/1602] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:55.101827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2c20f-919b-485a-9b77-bbba263d2b34 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.101827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2c20f-919b-485a-9b77-bbba263d2b34 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.101827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2c20f-919b-485a-9b77-bbba263d2b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.126359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-79d2c20f-919b-485a-9b77-bbba263d2b34 None None] MFA Rules not processed for user `c1a3d3e7ddef4a4fb859c52ceecb1b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:55.128845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-79d2c20f-919b-485a-9b77-bbba263d2b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:55.156920 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 806/1603] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:55 2022] PUT /identity/v3/projects/bec19c8306c6439b9392248450d21ec9/users/606b53c6f60d45cf9e2c3e5c6c9cde2e/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:55.160683 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841da4b4-668d-489e-9ce3-75fa88279c64 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:55.200551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 798/1604] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:55.200551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb3bcb-3c47-4dad-b180-7ea42b93dc08 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.200551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb3bcb-3c47-4dad-b180-7ea42b93dc08 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.200551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb3bcb-3c47-4dad-b180-7ea42b93dc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.238176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7dcb3bcb-3c47-4dad-b180-7ea42b93dc08 None None] MFA Rules not processed for user `ff746db0f04a408f9b3893e98b553ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:55.243920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7dcb3bcb-3c47-4dad-b180-7ea42b93dc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:55.244095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841da4b4-668d-489e-9ce3-75fa88279c64 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:55.248452 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3a00c-9728-4f81-8151-41c2a0323fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.249523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3a00c-9728-4f81-8151-41c2a0323fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.249523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3a00c-9728-4f81-8151-41c2a0323fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.249860 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3a00c-9728-4f81-8151-41c2a0323fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.250608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3a00c-9728-4f81-8151-41c2a0323fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.253088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3a00c-9728-4f81-8151-41c2a0323fcc admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.266805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 807/1605] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:55.266805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3a00c-9728-4f81-8151-41c2a0323fcc admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:55.275896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3a00c-9728-4f81-8151-41c2a0323fcc admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:55.281339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eea8a-e638-4dbf-a6c9-914b3182971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.282306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eea8a-e638-4dbf-a6c9-914b3182971c admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.282646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eea8a-e638-4dbf-a6c9-914b3182971c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.285472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eea8a-e638-4dbf-a6c9-914b3182971c admin admin] PATH_INFO: `/v3/projects/500b58188f1a4a088b52b67eb5772984/users/2a2b95ccb7804311a011f37ccb371771/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.300457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8eea8a-e638-4dbf-a6c9-914b3182971c admin admin] RBAC: Authorizing `identity:create_grant(project_id=500b58188f1a4a088b52b67eb5772984, user_id=2a2b95ccb7804311a011f37ccb371771, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.303565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8eea8a-e638-4dbf-a6c9-914b3182971c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.311186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 799/1606] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:55.315741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb3bcb-3c47-4dad-b180-7ea42b93dc08 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:55.326673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb3bcb-3c47-4dad-b180-7ea42b93dc08 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:55.331268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0f15-2a16-4dc8-9fe6-b20b0865a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.332164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0f15-2a16-4dc8-9fe6-b20b0865a8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.332455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0f15-2a16-4dc8-9fe6-b20b0865a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.332793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0f15-2a16-4dc8-9fe6-b20b0865a8c1 admin admin] PATH_INFO: `/v3/projects/afac0ca364954724a9a7c36f702c2d00/users/4982c1d62c194b7a9c4d8b4f064a21e1/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.348779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db0f15-2a16-4dc8-9fe6-b20b0865a8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afac0ca364954724a9a7c36f702c2d00, user_id=4982c1d62c194b7a9c4d8b4f064a21e1, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.351494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db0f15-2a16-4dc8-9fe6-b20b0865a8c1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.397032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 808/1607] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:55 2022] PUT /identity/v3/projects/500b58188f1a4a088b52b67eb5772984/users/2a2b95ccb7804311a011f37ccb371771/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:55.398779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639699b-de44-4326-bb5f-2d84ec29c958 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.398779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639699b-de44-4326-bb5f-2d84ec29c958 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.399002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639699b-de44-4326-bb5f-2d84ec29c958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.421011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-3639699b-de44-4326-bb5f-2d84ec29c958 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:55.425170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3639699b-de44-4326-bb5f-2d84ec29c958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:55.459058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 800/1608] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:55 2022] PUT /identity/v3/projects/afac0ca364954724a9a7c36f702c2d00/users/4982c1d62c194b7a9c4d8b4f064a21e1/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:55.460260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0f15-2a16-4dc8-9fe6-b20b0865a8c1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:55.497590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 809/1609] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:55.498587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639699b-de44-4326-bb5f-2d84ec29c958 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:55.508860 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639699b-de44-4326-bb5f-2d84ec29c958 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:55.552290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0f15-2a16-4dc8-9fe6-b20b0865a8c1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:55.555845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ef267-e00e-499f-abe0-ef9a4a2a6dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.556680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ef267-e00e-499f-abe0-ef9a4a2a6dac admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.557069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ef267-e00e-499f-abe0-ef9a4a2a6dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.557639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ef267-e00e-499f-abe0-ef9a4a2a6dac admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.558449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ef267-e00e-499f-abe0-ef9a4a2a6dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.560712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ef267-e00e-499f-abe0-ef9a4a2a6dac admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.573359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492ad69-827a-41fb-a5a3-58a133ade718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.574478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492ad69-827a-41fb-a5a3-58a133ade718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.574943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492ad69-827a-41fb-a5a3-58a133ade718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.575959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492ad69-827a-41fb-a5a3-58a133ade718 admin admin] PATH_INFO: `/v3/projects/a62555d4a0cd47a7808916c542ceebda/users/69c96e51e8274ddfbb04c703e133602e/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.592107 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492ad69-827a-41fb-a5a3-58a133ade718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62555d4a0cd47a7808916c542ceebda, user_id=69c96e51e8274ddfbb04c703e133602e, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.594224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492ad69-827a-41fb-a5a3-58a133ade718 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.623554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 801/1610] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:55 2022] POST /identity/v3/projects => generated 409 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:55.624477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ef267-e00e-499f-abe0-ef9a4a2a6dac admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:55.669841 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 810/1611] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:55 2022] PUT /identity/v3/projects/a62555d4a0cd47a7808916c542ceebda/users/69c96e51e8274ddfbb04c703e133602e/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:55.681912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2564f68-b21c-40b3-b1d2-30964bbaaada None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.682209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2564f68-b21c-40b3-b1d2-30964bbaaada None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.682501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2564f68-b21c-40b3-b1d2-30964bbaaada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.702058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ef267-e00e-499f-abe0-ef9a4a2a6dac admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:55.703080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a2564f68-b21c-40b3-b1d2-30964bbaaada None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:55.704301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a2564f68-b21c-40b3-b1d2-30964bbaaada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:55.760566 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6fabf-5c0c-4c36-bfbe-7de75e949c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.761175 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6fabf-5c0c-4c36-bfbe-7de75e949c52 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.761745 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6fabf-5c0c-4c36-bfbe-7de75e949c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.762036 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6fabf-5c0c-4c36-bfbe-7de75e949c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.783662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 811/1612] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:55.783662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71896-ea5d-4805-9a68-cc8c56beec07 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.783662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71896-ea5d-4805-9a68-cc8c56beec07 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.783662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af71896-ea5d-4805-9a68-cc8c56beec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.808891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-0af71896-ea5d-4805-9a68-cc8c56beec07 None None] MFA Rules not processed for user `4982c1d62c194b7a9c4d8b4f064a21e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:55.810901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0af71896-ea5d-4805-9a68-cc8c56beec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:55.834872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6fabf-5c0c-4c36-bfbe-7de75e949c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.836958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6fabf-5c0c-4c36-bfbe-7de75e949c52 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.851553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 802/1613] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:55.852448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6fabf-5c0c-4c36-bfbe-7de75e949c52 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:55.899781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 812/1614] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:55.899781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71896-ea5d-4805-9a68-cc8c56beec07 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:55.932138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af71896-ea5d-4805-9a68-cc8c56beec07 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:55.944476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8c6fa-172d-49d3-828b-f23f48c7aac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.944476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8c6fa-172d-49d3-828b-f23f48c7aac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.944476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8c6fa-172d-49d3-828b-f23f48c7aac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.944476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8c6fa-172d-49d3-828b-f23f48c7aac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.945033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6fabf-5c0c-4c36-bfbe-7de75e949c52 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:55.945164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8c6fa-172d-49d3-828b-f23f48c7aac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.945164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8c6fa-172d-49d3-828b-f23f48c7aac9 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.954486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a23fa3-e895-47d3-b572-97cf48cdd158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:55.955173 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a23fa3-e895-47d3-b572-97cf48cdd158 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.955647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a23fa3-e895-47d3-b572-97cf48cdd158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.955989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a23fa3-e895-47d3-b572-97cf48cdd158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:55.979251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a23fa3-e895-47d3-b572-97cf48cdd158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:55.980909 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a23fa3-e895-47d3-b572-97cf48cdd158 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:55.992846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 803/1615] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:55.993958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f398a-4dba-4556-80ee-dd95ead6e867 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:55.994251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f398a-4dba-4556-80ee-dd95ead6e867 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:55.994531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f398a-4dba-4556-80ee-dd95ead6e867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.034088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e96f398a-4dba-4556-80ee-dd95ead6e867 None None] MFA Rules not processed for user `69c96e51e8274ddfbb04c703e133602e`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:56.040263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 813/1616] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:55 2022] POST /identity/v3/users => generated 311 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:56.041110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8c6fa-172d-49d3-828b-f23f48c7aac9 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:56.042380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e96f398a-4dba-4556-80ee-dd95ead6e867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:56.052372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8c6fa-172d-49d3-828b-f23f48c7aac9 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:56.056200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b7e79-176f-4945-8da4-eea7d97285d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:56.056976 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b7e79-176f-4945-8da4-eea7d97285d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.057309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b7e79-176f-4945-8da4-eea7d97285d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.057647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b7e79-176f-4945-8da4-eea7d97285d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.068462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b7e79-176f-4945-8da4-eea7d97285d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:56.070541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b7e79-176f-4945-8da4-eea7d97285d6 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:56.082309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 814/1617] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:56.083778 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00622-7472-4c80-8f91-a016a1f996f4 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.084139 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00622-7472-4c80-8f91-a016a1f996f4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.084483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d00622-7472-4c80-8f91-a016a1f996f4 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.086261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 815/1618] 10.222.0.59 () {54 vars in 961 bytes} [Thu May 12 20:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:37:56.087079 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00622-7472-4c80-8f91-a016a1f996f4 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:56.103089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d00622-7472-4c80-8f91-a016a1f996f4 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:56.110999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2c4d0-42f7-4a62-9489-434862156d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:56.111861 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2c4d0-42f7-4a62-9489-434862156d94 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.112197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2c4d0-42f7-4a62-9489-434862156d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.112611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2c4d0-42f7-4a62-9489-434862156d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.114010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2c4d0-42f7-4a62-9489-434862156d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:56.115967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2c4d0-42f7-4a62-9489-434862156d94 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:56.134112 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 816/1619] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:56.135679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357fb7e-a5a2-4f94-b25a-a76db5e0c7b6 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.135985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357fb7e-a5a2-4f94-b25a-a76db5e0c7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.136892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357fb7e-a5a2-4f94-b25a-a76db5e0c7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.166609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 804/1620] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:56.170439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f398a-4dba-4556-80ee-dd95ead6e867 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:56.190741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-3357fb7e-a5a2-4f94-b25a-a76db5e0c7b6 None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:56.192955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3357fb7e-a5a2-4f94-b25a-a76db5e0c7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:56.198377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f398a-4dba-4556-80ee-dd95ead6e867 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:56.212920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7f05-5922-47c2-83e5-697e84b1f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:56.214155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7f05-5922-47c2-83e5-697e84b1f266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.217636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7f05-5922-47c2-83e5-697e84b1f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.217636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7f05-5922-47c2-83e5-697e84b1f266 admin admin] PATH_INFO: `/v3/projects/674a488f8524409bbf1b188ce73d3ee5/users/bd8702d1f59949debb487d686daf5fca/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.250065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c7f05-5922-47c2-83e5-697e84b1f266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674a488f8524409bbf1b188ce73d3ee5, user_id=bd8702d1f59949debb487d686daf5fca, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:56.253219 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c7f05-5922-47c2-83e5-697e84b1f266 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:56.325905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 817/1621] 10.222.0.59 () {58 vars in 1058 bytes} [Thu May 12 20:37:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:56.327125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357fb7e-a5a2-4f94-b25a-a76db5e0c7b6 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:56.343023 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357fb7e-a5a2-4f94-b25a-a76db5e0c7b6 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:56.361048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 805/1622] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:56 2022] PUT /identity/v3/projects/674a488f8524409bbf1b188ce73d3ee5/users/bd8702d1f59949debb487d686daf5fca/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:56.365548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7f05-5922-47c2-83e5-697e84b1f266 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:56.367184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d65963-4d8e-427b-a023-1d6449094c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:56.367893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d65963-4d8e-427b-a023-1d6449094c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.368183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d65963-4d8e-427b-a023-1d6449094c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.368467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d65963-4d8e-427b-a023-1d6449094c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.369182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d65963-4d8e-427b-a023-1d6449094c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:56.374628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d65963-4d8e-427b-a023-1d6449094c6d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:56.479430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7f05-5922-47c2-83e5-697e84b1f266 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:56.485496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 818/1623] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:56 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:56.488037 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d65963-4d8e-427b-a023-1d6449094c6d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:56.490957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1688c4-c547-43e4-b3d7-add28fcf707c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:56.491968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1688c4-c547-43e4-b3d7-add28fcf707c service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.492503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1688c4-c547-43e4-b3d7-add28fcf707c service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.492976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1688c4-c547-43e4-b3d7-add28fcf707c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.596158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1688c4-c547-43e4-b3d7-add28fcf707c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:56.597991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1688c4-c547-43e4-b3d7-add28fcf707c service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:56.600295 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d65963-4d8e-427b-a023-1d6449094c6d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:56.610105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 806/1624] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:56.611323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1688c4-c547-43e4-b3d7-add28fcf707c service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:56.612195 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebcb7d-bfc8-418d-b93e-9aff85f98972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:56.613579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebcb7d-bfc8-418d-b93e-9aff85f98972 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.613897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebcb7d-bfc8-418d-b93e-9aff85f98972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.614386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebcb7d-bfc8-418d-b93e-9aff85f98972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.615177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebcb7d-bfc8-418d-b93e-9aff85f98972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:56.617209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebcb7d-bfc8-418d-b93e-9aff85f98972 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:56.649286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 819/1625] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:56.650264 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebcb7d-bfc8-418d-b93e-9aff85f98972 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:56.690017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebcb7d-bfc8-418d-b93e-9aff85f98972 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:56.702981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783f312-a765-475a-9e36-92949c6cece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:56.706344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783f312-a765-475a-9e36-92949c6cece5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.706958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783f312-a765-475a-9e36-92949c6cece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.707253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783f312-a765-475a-9e36-92949c6cece5 admin admin] PATH_INFO: `/v3/projects/674a488f8524409bbf1b188ce73d3ee5/users/bd8702d1f59949debb487d686daf5fca/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.713181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783f312-a765-475a-9e36-92949c6cece5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674a488f8524409bbf1b188ce73d3ee5, user_id=bd8702d1f59949debb487d686daf5fca, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:56.720187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783f312-a765-475a-9e36-92949c6cece5 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:56.760200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 820/1626] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:56 2022] PUT /identity/v3/projects/674a488f8524409bbf1b188ce73d3ee5/users/bd8702d1f59949debb487d686daf5fca/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:56.761579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1688c4-c547-43e4-b3d7-add28fcf707c service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:56.772644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c39c8-62b0-4188-a143-0df5a3467c22 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.772986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c39c8-62b0-4188-a143-0df5a3467c22 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.773200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c39c8-62b0-4188-a143-0df5a3467c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.835818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-c37c39c8-62b0-4188-a143-0df5a3467c22 None None] MFA Rules not processed for user `bd8702d1f59949debb487d686daf5fca`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:56.837042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c37c39c8-62b0-4188-a143-0df5a3467c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:56.914439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a403ec0-39ca-462d-89d5-848846c55061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:56.915356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a403ec0-39ca-462d-89d5-848846c55061 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:56.915855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a403ec0-39ca-462d-89d5-848846c55061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:56.916221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a403ec0-39ca-462d-89d5-848846c55061 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:56.923862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a403ec0-39ca-462d-89d5-848846c55061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:56.926579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a403ec0-39ca-462d-89d5-848846c55061 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:57.036397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 821/1627] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:56 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:57.037370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c39c8-62b0-4188-a143-0df5a3467c22 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:57.045204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 807/1628] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:56 2022] POST /identity/v3/users => generated 294 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:57.047963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a403ec0-39ca-462d-89d5-848846c55061 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:57.062951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c39c8-62b0-4188-a143-0df5a3467c22 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:57.074132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800664b2-ae20-4963-9706-732071e5726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:57.074744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800664b2-ae20-4963-9706-732071e5726c admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.075146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800664b2-ae20-4963-9706-732071e5726c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.075593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800664b2-ae20-4963-9706-732071e5726c admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.076500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800664b2-ae20-4963-9706-732071e5726c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:57.084344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800664b2-ae20-4963-9706-732071e5726c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:57.114019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 822/1629] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:57.114019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53c75-3854-4441-9ad7-58e396b32b62 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.114019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53c75-3854-4441-9ad7-58e396b32b62 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.114019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f53c75-3854-4441-9ad7-58e396b32b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.182433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a403ec0-39ca-462d-89d5-848846c55061 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:57.183561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-25f53c75-3854-4441-9ad7-58e396b32b62 None None] MFA Rules not processed for user `0034ea4df67849d193d6fabca6395773`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:57.185068 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-25f53c75-3854-4441-9ad7-58e396b32b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:57.187448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c784d58-a81d-4364-8c38-a43073996dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:57.188303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c784d58-a81d-4364-8c38-a43073996dac service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.188647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c784d58-a81d-4364-8c38-a43073996dac service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.188937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c784d58-a81d-4364-8c38-a43073996dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.202532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c784d58-a81d-4364-8c38-a43073996dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:57.204396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c784d58-a81d-4364-8c38-a43073996dac service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:57.230862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 808/1630] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:37:57.232761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c784d58-a81d-4364-8c38-a43073996dac service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:57.282648 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c784d58-a81d-4364-8c38-a43073996dac service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:57.298497 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9b1b4-2d43-4b83-877c-cfffc655d640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:57.301056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9b1b4-2d43-4b83-877c-cfffc655d640 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.303698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9b1b4-2d43-4b83-877c-cfffc655d640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.304772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9b1b4-2d43-4b83-877c-cfffc655d640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.305748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9b1b4-2d43-4b83-877c-cfffc655d640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:57.309110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9b1b4-2d43-4b83-877c-cfffc655d640 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:57.311661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 823/1631] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:57.313458 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730e312-6a39-43f1-a360-16a1d1a95920 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.313758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730e312-6a39-43f1-a360-16a1d1a95920 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.314050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730e312-6a39-43f1-a360-16a1d1a95920 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.328633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 824/1632] 10.222.0.59 () {54 vars in 912 bytes} [Thu May 12 20:37:57 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:37:57.331834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e35c54-c322-4a8d-b711-fde7b27a59b7 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.332527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e35c54-c322-4a8d-b711-fde7b27a59b7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.333552 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e35c54-c322-4a8d-b711-fde7b27a59b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.354811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 809/1633] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:57.358970 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15669-f6eb-4ff8-bec9-9c2762418aca None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.359296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15669-f6eb-4ff8-bec9-9c2762418aca None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.359845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15669-f6eb-4ff8-bec9-9c2762418aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.388338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a2e15669-f6eb-4ff8-bec9-9c2762418aca None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:57.388617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-84e35c54-c322-4a8d-b711-fde7b27a59b7 None None] MFA Rules not processed for user `0034ea4df67849d193d6fabca6395773`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:57.388770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a2e15669-f6eb-4ff8-bec9-9c2762418aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:57.388975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-84e35c54-c322-4a8d-b711-fde7b27a59b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:57.412991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 825/1634] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:57.422489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e35c54-c322-4a8d-b711-fde7b27a59b7 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:57.463905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e35c54-c322-4a8d-b711-fde7b27a59b7 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:57.469098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b66c65-6d57-476e-9e5d-b706a425db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:57.472400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b66c65-6d57-476e-9e5d-b706a425db83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.473497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b66c65-6d57-476e-9e5d-b706a425db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.473792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b66c65-6d57-476e-9e5d-b706a425db83 admin admin] PATH_INFO: `/v3/projects/67c79006ecd6400881521d789a697513/users/b035442ab1b34be599d9c6bdc9568593/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.489233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 810/1635] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:57.490822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f60ec-ddd1-47a6-a825-b1693a70745e None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.490939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f60ec-ddd1-47a6-a825-b1693a70745e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.499385 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f60ec-ddd1-47a6-a825-b1693a70745e None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.505343 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 811/1636] 10.222.0.59 () {54 vars in 961 bytes} [Thu May 12 20:37:57 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:37:57.509659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d17545-4701-495f-987b-a9fecd13ee75 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.509956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d17545-4701-495f-987b-a9fecd13ee75 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.510242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d17545-4701-495f-987b-a9fecd13ee75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.516793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b66c65-6d57-476e-9e5d-b706a425db83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c79006ecd6400881521d789a697513, user_id=b035442ab1b34be599d9c6bdc9568593, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:57.525237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b66c65-6d57-476e-9e5d-b706a425db83 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:57.556368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-59d17545-4701-495f-987b-a9fecd13ee75 None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:57.560022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-59d17545-4701-495f-987b-a9fecd13ee75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:57.580062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 812/1637] 10.222.0.59 () {58 vars in 1058 bytes} [Thu May 12 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:57.581915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d17545-4701-495f-987b-a9fecd13ee75 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:57.601842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d17545-4701-495f-987b-a9fecd13ee75 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:57.601842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0031e-13c2-4e32-a314-6719f8a58854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:57.601842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0031e-13c2-4e32-a314-6719f8a58854 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.601842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0031e-13c2-4e32-a314-6719f8a58854 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.602585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0031e-13c2-4e32-a314-6719f8a58854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.617890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0031e-13c2-4e32-a314-6719f8a58854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:57.639395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 826/1638] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:57 2022] PUT /identity/v3/projects/67c79006ecd6400881521d789a697513/users/b035442ab1b34be599d9c6bdc9568593/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:57.640987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b66c65-6d57-476e-9e5d-b706a425db83 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:57.644909 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0031e-13c2-4e32-a314-6719f8a58854 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:57.675085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 813/1639] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:57.676485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1306b-d03a-490d-a861-5c76463f481d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.676485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1306b-d03a-490d-a861-5c76463f481d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.677061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1306b-d03a-490d-a861-5c76463f481d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.739460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0df1306b-d03a-490d-a861-5c76463f481d None None] MFA Rules not processed for user `b035442ab1b34be599d9c6bdc9568593`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:57.741072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0df1306b-d03a-490d-a861-5c76463f481d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:57.834787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b66c65-6d57-476e-9e5d-b706a425db83 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:57.857670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794f59-c41c-44a3-b801-e2b827331ed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:57.862524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794f59-c41c-44a3-b801-e2b827331ed9 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:57.862524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794f59-c41c-44a3-b801-e2b827331ed9 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:57.862794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794f59-c41c-44a3-b801-e2b827331ed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:57.886766 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 814/1640] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:57.891399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1306b-d03a-490d-a861-5c76463f481d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:57.963866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49794f59-c41c-44a3-b801-e2b827331ed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:57.966056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49794f59-c41c-44a3-b801-e2b827331ed9 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:57.976679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 827/1641] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:57.996789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1306b-d03a-490d-a861-5c76463f481d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:58.000668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794f59-c41c-44a3-b801-e2b827331ed9 service nova] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:58.002655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eeaf6-4998-4eea-930f-54d9e2cf9f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:58.003335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eeaf6-4998-4eea-930f-54d9e2cf9f7e admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:58.003675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eeaf6-4998-4eea-930f-54d9e2cf9f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:58.004055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eeaf6-4998-4eea-930f-54d9e2cf9f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:58.004866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eeaf6-4998-4eea-930f-54d9e2cf9f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:58.008171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eeaf6-4998-4eea-930f-54d9e2cf9f7e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:58.129306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794f59-c41c-44a3-b801-e2b827331ed9 service nova] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:58.140944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e11cc-d71f-488f-98de-c00458bfca8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:58.149210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e11cc-d71f-488f-98de-c00458bfca8a service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:58.149210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e11cc-d71f-488f-98de-c00458bfca8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:58.149210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e11cc-d71f-488f-98de-c00458bfca8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:58.149557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 815/1642] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:37:57 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:58.149557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eeaf6-4998-4eea-930f-54d9e2cf9f7e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:58.315559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eeaf6-4998-4eea-930f-54d9e2cf9f7e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:58.327479 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da5f85-bfbc-491c-bc21-97477bf3d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:58.327885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da5f85-bfbc-491c-bc21-97477bf3d84d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:58.328186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da5f85-bfbc-491c-bc21-97477bf3d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:58.328456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da5f85-bfbc-491c-bc21-97477bf3d84d admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:58.329124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da5f85-bfbc-491c-bc21-97477bf3d84d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:58.331085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da5f85-bfbc-491c-bc21-97477bf3d84d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:58.496631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 816/1643] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:37:58 2022] POST /identity/v3/users => generated 299 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:37:58.499453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d8749-a1fe-424e-8032-3891fd5889f5 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:58.499453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d8749-a1fe-424e-8032-3891fd5889f5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:58.499453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d8749-a1fe-424e-8032-3891fd5889f5 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:58.500497 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 817/1644] 10.222.0.59 () {54 vars in 912 bytes} [Thu May 12 20:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:37:58.514259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d8749-a1fe-424e-8032-3891fd5889f5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:58.550878 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d8749-a1fe-424e-8032-3891fd5889f5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:58.562637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7261c1-1427-40dd-9afc-cf22fd59f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:58.563322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7261c1-1427-40dd-9afc-cf22fd59f0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:58.563604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7261c1-1427-40dd-9afc-cf22fd59f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:58.563884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7261c1-1427-40dd-9afc-cf22fd59f0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:58.564647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7261c1-1427-40dd-9afc-cf22fd59f0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:58.566283 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7261c1-1427-40dd-9afc-cf22fd59f0ed admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:58.574507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e11cc-d71f-488f-98de-c00458bfca8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:58.577206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e11cc-d71f-488f-98de-c00458bfca8a service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:58.599080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 818/1645] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:58.605009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552bea4-d6e2-438d-b110-c8783b253f22 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:58.605324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552bea4-d6e2-438d-b110-c8783b253f22 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:58.605613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552bea4-d6e2-438d-b110-c8783b253f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:58.614530 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 828/1646] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:58.615278 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e11cc-d71f-488f-98de-c00458bfca8a service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:58.630937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e11cc-d71f-488f-98de-c00458bfca8a service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:58.636394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e552bea4-d6e2-438d-b110-c8783b253f22 None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:58.641468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd96a-e82f-4591-a82c-1c4f3489b5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:58.642222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e552bea4-d6e2-438d-b110-c8783b253f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:58.642306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd96a-e82f-4591-a82c-1c4f3489b5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:58.642306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd96a-e82f-4591-a82c-1c4f3489b5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:58.642306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd96a-e82f-4591-a82c-1c4f3489b5f5 admin admin] PATH_INFO: `/v3/projects/e9afca365b8f4da5968f47120d9c5fe7/users/d0ec8b32352f4a85a17095c8fb4ed7ea/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:58.679723 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdd96a-e82f-4591-a82c-1c4f3489b5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9afca365b8f4da5968f47120d9c5fe7, user_id=d0ec8b32352f4a85a17095c8fb4ed7ea, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:58.682746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdd96a-e82f-4591-a82c-1c4f3489b5f5 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:58.808271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 819/1647] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:37:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:58.818104 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 829/1648] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:58 2022] PUT /identity/v3/projects/e9afca365b8f4da5968f47120d9c5fe7/users/d0ec8b32352f4a85a17095c8fb4ed7ea/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:58.827390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552bea4-d6e2-438d-b110-c8783b253f22 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:58.827794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd96a-e82f-4591-a82c-1c4f3489b5f5 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:58.828851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-83bdd96a-e82f-4591-a82c-1c4f3489b5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:58.842950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552bea4-d6e2-438d-b110-c8783b253f22 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:59.011890 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd96a-e82f-4591-a82c-1c4f3489b5f5 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:59.024636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6e64d-4150-41af-bb86-0ea5bc004d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:59.025493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bccc91-e131-4d9b-9e91-9a5bd4268d74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f8ec4765e05461a98b3c9eb1d3ced5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:59.026360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bccc91-e131-4d9b-9e91-9a5bd4268d74 service glance] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:59.027154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e64d-4150-41af-bb86-0ea5bc004d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:59.032018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bccc91-e131-4d9b-9e91-9a5bd4268d74 service glance] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:59.032552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e64d-4150-41af-bb86-0ea5bc004d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:59.033130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bccc91-e131-4d9b-9e91-9a5bd4268d74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:59.033440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e64d-4150-41af-bb86-0ea5bc004d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:59.034886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6e64d-4150-41af-bb86-0ea5bc004d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:59.037055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6e64d-4150-41af-bb86-0ea5bc004d4a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:59.062215 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 820/1649] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:37:59.070320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6e64d-4150-41af-bb86-0ea5bc004d4a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:59.101037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6e64d-4150-41af-bb86-0ea5bc004d4a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:59.110282 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1910-0e96-4ca2-9595-8b0ceb1b6768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:59.112885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1910-0e96-4ca2-9595-8b0ceb1b6768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:59.113723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1910-0e96-4ca2-9595-8b0ceb1b6768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:59.114088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1910-0e96-4ca2-9595-8b0ceb1b6768 admin admin] PATH_INFO: `/v3/projects/e9afca365b8f4da5968f47120d9c5fe7/users/d0ec8b32352f4a85a17095c8fb4ed7ea/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:59.118885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe1910-0e96-4ca2-9595-8b0ceb1b6768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9afca365b8f4da5968f47120d9c5fe7, user_id=d0ec8b32352f4a85a17095c8fb4ed7ea, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:59.127171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe1910-0e96-4ca2-9595-8b0ceb1b6768 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:59.149428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 821/1650] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:37:59 2022] PUT /identity/v3/projects/e9afca365b8f4da5968f47120d9c5fe7/users/d0ec8b32352f4a85a17095c8fb4ed7ea/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:37:59.164482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e845e-2097-4025-87d6-378db869a02f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:59.164482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e845e-2097-4025-87d6-378db869a02f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:59.164482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e845e-2097-4025-87d6-378db869a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:59.200927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bccc91-e131-4d9b-9e91-9a5bd4268d74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:59.202487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bccc91-e131-4d9b-9e91-9a5bd4268d74 service glance] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:59.227563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 830/1651] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:37:59.296329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d49e845e-2097-4025-87d6-378db869a02f None None] MFA Rules not processed for user `d0ec8b32352f4a85a17095c8fb4ed7ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:37:59.298373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d49e845e-2097-4025-87d6-378db869a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:37:59.431990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 822/1652] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:37:59.445124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bccc91-e131-4d9b-9e91-9a5bd4268d74 service glance] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:37:59.521785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bccc91-e131-4d9b-9e91-9a5bd4268d74 service glance] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:37:59.663148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939b1c4-1063-4b8f-a874-d7cf92353095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:37:59.663909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939b1c4-1063-4b8f-a874-d7cf92353095 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:37:59.664014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939b1c4-1063-4b8f-a874-d7cf92353095 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:37:59.664296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939b1c4-1063-4b8f-a874-d7cf92353095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:37:59.694388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939b1c4-1063-4b8f-a874-d7cf92353095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:37:59.695888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939b1c4-1063-4b8f-a874-d7cf92353095 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:37:59.741147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 831/1653] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:37:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:00.377836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded5478-c4fb-4a6a-9f2c-1d9121479f74 None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:00.378391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded5478-c4fb-4a6a-9f2c-1d9121479f74 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:00.378391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded5478-c4fb-4a6a-9f2c-1d9121479f74 None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:00.380029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 823/1654] 10.222.0.59 () {54 vars in 912 bytes} [Thu May 12 20:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:38:00.385478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb81bc-b6b8-40b3-83de-b96b4cd94f51 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:00.389875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb81bc-b6b8-40b3-83de-b96b4cd94f51 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:00.389875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb81bc-b6b8-40b3-83de-b96b4cd94f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:00.432469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-40eb81bc-b6b8-40b3-83de-b96b4cd94f51 None None] MFA Rules not processed for user `4379d3e8b38645978efb08ea6f560fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:00.437864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-40eb81bc-b6b8-40b3-83de-b96b4cd94f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:00.597104 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 832/1655] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:38:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:00.639809 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded5478-c4fb-4a6a-9f2c-1d9121479f74 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:00.656444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded5478-c4fb-4a6a-9f2c-1d9121479f74 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:00.665098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811c27a-b499-4b3e-b5a4-e277907ddffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:00.666335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c27a-b499-4b3e-b5a4-e277907ddffe service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:00.667196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c27a-b499-4b3e-b5a4-e277907ddffe service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:00.668093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c27a-b499-4b3e-b5a4-e277907ddffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:00.680229 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811c27a-b499-4b3e-b5a4-e277907ddffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:00.682122 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811c27a-b499-4b3e-b5a4-e277907ddffe service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:00.693913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 824/1656] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:01.685143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008717ff-9950-496e-8b8c-64ba1ca7e8ae None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:01.685876 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008717ff-9950-496e-8b8c-64ba1ca7e8ae None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:01.685989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008717ff-9950-496e-8b8c-64ba1ca7e8ae None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:01.687516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 833/1657] 10.222.0.59 () {54 vars in 960 bytes} [Thu May 12 20:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:38:01.695348 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d02c1-c4d8-4b1b-9613-e16778a0c8af None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:01.695348 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d02c1-c4d8-4b1b-9613-e16778a0c8af None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:01.695348 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d02c1-c4d8-4b1b-9613-e16778a0c8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:01.727659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-eb0d02c1-c4d8-4b1b-9613-e16778a0c8af None None] MFA Rules not processed for user `65431a33849249ed8686d03b0c2e3a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:01.732782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-eb0d02c1-c4d8-4b1b-9613-e16778a0c8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:01.969867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 825/1658] 10.222.0.59 () {58 vars in 1057 bytes} [Thu May 12 20:38:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:01.982249 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008717ff-9950-496e-8b8c-64ba1ca7e8ae None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:02.008909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008717ff-9950-496e-8b8c-64ba1ca7e8ae None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:02.029350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8560ac-f84c-4170-8486-4756fc31af0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:02.030270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8560ac-f84c-4170-8486-4756fc31af0f service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:02.030558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8560ac-f84c-4170-8486-4756fc31af0f service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:02.030844 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8560ac-f84c-4170-8486-4756fc31af0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:02.043037 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6f8560ac-f84c-4170-8486-4756fc31af0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:02.073833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8560ac-f84c-4170-8486-4756fc31af0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:02.076230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8560ac-f84c-4170-8486-4756fc31af0f service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:02.103873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 834/1659] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:02.566939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d02c1-c4d8-4b1b-9613-e16778a0c8af None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:02.685490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8560ac-f84c-4170-8486-4756fc31af0f service placement] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:02.696690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8560ac-f84c-4170-8486-4756fc31af0f service placement] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:02.703770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a111-4734-4724-a098-ad6a79e86dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:02.705215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a111-4734-4724-a098-ad6a79e86dca service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:02.705738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a111-4734-4724-a098-ad6a79e86dca service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:02.706288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a111-4734-4724-a098-ad6a79e86dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:02.792479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076a111-4734-4724-a098-ad6a79e86dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:02.795652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076a111-4734-4724-a098-ad6a79e86dca service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:02.796399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d02c1-c4d8-4b1b-9613-e16778a0c8af None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:02.808830 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 835/1660] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:02.815465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:02.816377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:02.816665 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:02.816943 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] PATH_INFO: `/v3/users/4982c1d62c194b7a9c4d8b4f064a21e1` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:02.826511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4982c1d62c194b7a9c4d8b4f064a21e1)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:02.827826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: WARNING py.warnings [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:38:02.827826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: warnings.warn(msg) May 12 20:38:02.827826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: May 12 20:38:02.829563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:03.168119 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4982c1d62c194b7a9c4d8b4f064a21e1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:03.203008 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4982c1d62c194b7a9c4d8b4f064a21e1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:03.203870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4982c1d62c194b7a9c4d8b4f064a21e1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:03.313322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4982c1d62c194b7a9c4d8b4f064a21e1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:03.341073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4982c1d62c194b7a9c4d8b4f064a21e1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:03.389851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 826/1661] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:02 2022] DELETE /identity/v3/users/4982c1d62c194b7a9c4d8b4f064a21e1 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:03.393508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de42780-1a37-4dda-bb51-183a709ffb08 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:03.393867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de42780-1a37-4dda-bb51-183a709ffb08 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:03.394154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de42780-1a37-4dda-bb51-183a709ffb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:03.427251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-3de42780-1a37-4dda-bb51-183a709ffb08 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:03.431831 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3de42780-1a37-4dda-bb51-183a709ffb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:03.623442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 836/1662] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:03.648659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:03.650921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:03.839853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a6c0e-16df-4ae7-9d04-af4167bbded6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:03.878406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384a317-7b7c-4e4e-84e0-d3072fd92b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:03.883419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384a317-7b7c-4e4e-84e0-d3072fd92b2b service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:03.883867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384a317-7b7c-4e4e-84e0-d3072fd92b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:03.885541 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384a317-7b7c-4e4e-84e0-d3072fd92b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:03.915317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384a317-7b7c-4e4e-84e0-d3072fd92b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:03.916977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384a317-7b7c-4e4e-84e0-d3072fd92b2b service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:03.930581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 827/1663] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:05.274263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de42780-1a37-4dda-bb51-183a709ffb08 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:05.276056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3de42780-1a37-4dda-bb51-183a709ffb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:05.300327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de42780-1a37-4dda-bb51-183a709ffb08 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:05.316159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:05.318143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:05.318638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:05.319005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] PATH_INFO: `/v3/projects/afac0ca364954724a9a7c36f702c2d00` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:05.330645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=afac0ca364954724a9a7c36f702c2d00)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:05.333078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: WARNING py.warnings [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 20:38:05.333078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: warnings.warn(msg) May 12 20:38:05.333078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: May 12 20:38:05.334586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:05.647420 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afac0ca364954724a9a7c36f702c2d00', 'request_id': 'req-976935c6-88a5-4e71-bccf-ca8257804acb'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:05.672190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afac0ca364954724a9a7c36f702c2d00', 'request_id': 'req-976935c6-88a5-4e71-bccf-ca8257804acb'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:05.785791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afac0ca364954724a9a7c36f702c2d00', 'request_id': 'req-976935c6-88a5-4e71-bccf-ca8257804acb'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:05.836760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] The token cache is being invalidate because project afac0ca364954724a9a7c36f702c2d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:05.837053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:05.839122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-976935c6-88a5-4e71-bccf-ca8257804acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:05.844293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 837/1664] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:05 2022] DELETE /identity/v3/projects/afac0ca364954724a9a7c36f702c2d00 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:05.847705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c646d6-9991-4e73-933c-0c156edcfe4f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:05.848835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c646d6-9991-4e73-933c-0c156edcfe4f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:05.849264 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c646d6-9991-4e73-933c-0c156edcfe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:05.885958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-15c646d6-9991-4e73-933c-0c156edcfe4f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:05.888724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-15c646d6-9991-4e73-933c-0c156edcfe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:06.054156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89df2d-5b3a-49ff-81c0-da3876285f5a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:06.054866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89df2d-5b3a-49ff-81c0-da3876285f5a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:06.055271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89df2d-5b3a-49ff-81c0-da3876285f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:06.056232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 828/1665] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:06.090084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-2f89df2d-5b3a-49ff-81c0-da3876285f5a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:06.092531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2f89df2d-5b3a-49ff-81c0-da3876285f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:06.109187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 838/1666] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:06.113849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c646d6-9991-4e73-933c-0c156edcfe4f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:06.127099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c646d6-9991-4e73-933c-0c156edcfe4f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:06.151156 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1929-d680-4a2d-ae71-8844524ad2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:06.152076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1929-d680-4a2d-ae71-8844524ad2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:06.152814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1929-d680-4a2d-ae71-8844524ad2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:06.153848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1929-d680-4a2d-ae71-8844524ad2f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:06.155146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1929-d680-4a2d-ae71-8844524ad2f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:38:06.155822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1929-d680-4a2d-ae71-8844524ad2f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:06.158870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1929-d680-4a2d-ae71-8844524ad2f5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:06.186457 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 829/1667] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:38:06.191158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89df2d-5b3a-49ff-81c0-da3876285f5a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:06.213697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89df2d-5b3a-49ff-81c0-da3876285f5a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:06.231821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b8dfb-612a-4d69-afe6-f2cd42e2fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:06.236994 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b8dfb-612a-4d69-afe6-f2cd42e2fe22 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:06.238329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b8dfb-612a-4d69-afe6-f2cd42e2fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:06.238745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b8dfb-612a-4d69-afe6-f2cd42e2fe22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:06.249679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b8dfb-612a-4d69-afe6-f2cd42e2fe22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:06.249679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b8dfb-612a-4d69-afe6-f2cd42e2fe22 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:06.381815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 839/1668] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:06 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:06.382603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1929-d680-4a2d-ae71-8844524ad2f5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:06.400352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1929-d680-4a2d-ae71-8844524ad2f5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:06.566098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572c18d-2ff1-48a8-a2bd-50f0fd7e43e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:06.566597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572c18d-2ff1-48a8-a2bd-50f0fd7e43e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:06.566888 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572c18d-2ff1-48a8-a2bd-50f0fd7e43e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:06.567174 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572c18d-2ff1-48a8-a2bd-50f0fd7e43e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:06.567903 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572c18d-2ff1-48a8-a2bd-50f0fd7e43e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:06.575730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572c18d-2ff1-48a8-a2bd-50f0fd7e43e5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:06.660873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7914-7b90-4d9a-9068-194ae88b3272 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:06.661172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7914-7b90-4d9a-9068-194ae88b3272 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:06.662010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7914-7b90-4d9a-9068-194ae88b3272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:06.699691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 830/1669] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:06 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:38:06.703944 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572c18d-2ff1-48a8-a2bd-50f0fd7e43e5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:06.714788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f5fe7914-7b90-4d9a-9068-194ae88b3272 None None] MFA Rules not processed for user `64ce721d7163430dbf31ffbbf28c2094`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:06.717967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f5fe7914-7b90-4d9a-9068-194ae88b3272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:06.742656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572c18d-2ff1-48a8-a2bd-50f0fd7e43e5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:06.759724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9b87b-5a78-42bf-91c3-d5050e5cc79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:06.760422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9b87b-5a78-42bf-91c3-d5050e5cc79c admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:06.760706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9b87b-5a78-42bf-91c3-d5050e5cc79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:06.760986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9b87b-5a78-42bf-91c3-d5050e5cc79c admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:06.762824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9b87b-5a78-42bf-91c3-d5050e5cc79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:06.764527 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9b87b-5a78-42bf-91c3-d5050e5cc79c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:06.807646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 831/1670] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:06.810834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9b87b-5a78-42bf-91c3-d5050e5cc79c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:06.851077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9b87b-5a78-42bf-91c3-d5050e5cc79c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:06.875824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a023140-81ca-4e8b-98d3-dba0cf13dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:06.876781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a023140-81ca-4e8b-98d3-dba0cf13dbef admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:06.877069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a023140-81ca-4e8b-98d3-dba0cf13dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:06.877373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a023140-81ca-4e8b-98d3-dba0cf13dbef admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:06.878114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a023140-81ca-4e8b-98d3-dba0cf13dbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:06.879745 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a023140-81ca-4e8b-98d3-dba0cf13dbef admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:06.882214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 840/1671] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:06.895678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe7914-7b90-4d9a-9068-194ae88b3272 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:06.898154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f5fe7914-7b90-4d9a-9068-194ae88b3272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:06.933715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 832/1672] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:06.933715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a023140-81ca-4e8b-98d3-dba0cf13dbef admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:06.963538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a023140-81ca-4e8b-98d3-dba0cf13dbef admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:06.991497 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741c8d8-8eb7-4ba4-b9fe-ff7322f5c3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:06.992503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c8d8-8eb7-4ba4-b9fe-ff7322f5c3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:06.992692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c8d8-8eb7-4ba4-b9fe-ff7322f5c3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:06.992978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741c8d8-8eb7-4ba4-b9fe-ff7322f5c3d0 admin admin] PATH_INFO: `/v3/projects/1f9490fdc2dd468d87ee3369af51f339/users/d9e64a3f17c347659eed5816eee2d383/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:07.068809 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741c8d8-8eb7-4ba4-b9fe-ff7322f5c3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9490fdc2dd468d87ee3369af51f339, user_id=d9e64a3f17c347659eed5816eee2d383, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:07.077704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741c8d8-8eb7-4ba4-b9fe-ff7322f5c3d0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:07.098834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe7914-7b90-4d9a-9068-194ae88b3272 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:07.117588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17505c6-f631-4a17-94a9-25d6000adeac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:07.118532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17505c6-f631-4a17-94a9-25d6000adeac service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:07.119086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17505c6-f631-4a17-94a9-25d6000adeac service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:07.119542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17505c6-f631-4a17-94a9-25d6000adeac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:07.130936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17505c6-f631-4a17-94a9-25d6000adeac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:07.132871 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17505c6-f631-4a17-94a9-25d6000adeac service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:07.144206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 841/1673] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:38:07.212332 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 833/1674] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:06 2022] PUT /identity/v3/projects/1f9490fdc2dd468d87ee3369af51f339/users/d9e64a3f17c347659eed5816eee2d383/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:07.214061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e649-f4ae-4635-8163-6fb764855a6c None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:07.214470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e649-f4ae-4635-8163-6fb764855a6c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:07.214850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184e649-f4ae-4635-8163-6fb764855a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:07.295986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-e184e649-f4ae-4635-8163-6fb764855a6c None None] MFA Rules not processed for user `d9e64a3f17c347659eed5816eee2d383`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:07.297521 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e184e649-f4ae-4635-8163-6fb764855a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:07.502462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 842/1675] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:07.504469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741c8d8-8eb7-4ba4-b9fe-ff7322f5c3d0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:07.704705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741c8d8-8eb7-4ba4-b9fe-ff7322f5c3d0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:07.718097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef125e0-47e1-457e-ab29-c7932eb04a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:07.718803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef125e0-47e1-457e-ab29-c7932eb04a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:07.719105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef125e0-47e1-457e-ab29-c7932eb04a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:07.719418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef125e0-47e1-457e-ab29-c7932eb04a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:07.720153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef125e0-47e1-457e-ab29-c7932eb04a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:07.722093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef125e0-47e1-457e-ab29-c7932eb04a7e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:07.907254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 834/1676] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:07 2022] POST /identity/v3/projects => generated 373 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:07.922057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184e649-f4ae-4635-8163-6fb764855a6c None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:07.958347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184e649-f4ae-4635-8163-6fb764855a6c None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:08.108359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fe78b-c869-4bbb-949c-e5ee144cfa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:08.113619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fe78b-c869-4bbb-949c-e5ee144cfa7d admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:08.113619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fe78b-c869-4bbb-949c-e5ee144cfa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:08.113619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fe78b-c869-4bbb-949c-e5ee144cfa7d admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:08.114948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fe78b-c869-4bbb-949c-e5ee144cfa7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:08.122461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fe78b-c869-4bbb-949c-e5ee144cfa7d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:08.260805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 843/1677] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:07 2022] POST /identity/v3/users => generated 293 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:08.265133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef125e0-47e1-457e-ab29-c7932eb04a7e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:08.278372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef125e0-47e1-457e-ab29-c7932eb04a7e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:08.294618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec2d19-28ea-4544-a9cd-b54ff16b6c46 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:08.295001 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec2d19-28ea-4544-a9cd-b54ff16b6c46 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:08.295292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec2d19-28ea-4544-a9cd-b54ff16b6c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:08.301920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde58cc6-3934-4196-a1f4-a55fcbc24369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:08.302615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde58cc6-3934-4196-a1f4-a55fcbc24369 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:08.302904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde58cc6-3934-4196-a1f4-a55fcbc24369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:08.303178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde58cc6-3934-4196-a1f4-a55fcbc24369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:08.305797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde58cc6-3934-4196-a1f4-a55fcbc24369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:08.314499 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde58cc6-3934-4196-a1f4-a55fcbc24369 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:08.354062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-69ec2d19-28ea-4544-a9cd-b54ff16b6c46 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:08.355150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-69ec2d19-28ea-4544-a9cd-b54ff16b6c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:08.378786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 835/1678] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:08.379910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde58cc6-3934-4196-a1f4-a55fcbc24369 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:08.428009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde58cc6-3934-4196-a1f4-a55fcbc24369 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:08.486072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667b3f9-0508-4892-b09d-e3f36189d3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:08.489770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667b3f9-0508-4892-b09d-e3f36189d3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:08.492937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667b3f9-0508-4892-b09d-e3f36189d3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:08.493740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667b3f9-0508-4892-b09d-e3f36189d3ec admin admin] PATH_INFO: `/v3/projects/25b68bc9254342068fef54877dfba966/users/39ea2326c02040e1811aacaad93a01f9/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:08.544209 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667b3f9-0508-4892-b09d-e3f36189d3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b68bc9254342068fef54877dfba966, user_id=39ea2326c02040e1811aacaad93a01f9, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:08.549346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667b3f9-0508-4892-b09d-e3f36189d3ec admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:08.627468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 844/1679] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:08.630647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 836/1680] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:08 2022] PUT /identity/v3/projects/25b68bc9254342068fef54877dfba966/users/39ea2326c02040e1811aacaad93a01f9/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:08.635258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667b3f9-0508-4892-b09d-e3f36189d3ec admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:08.813296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667b3f9-0508-4892-b09d-e3f36189d3ec admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:08.830315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78f556-c63b-4246-b466-2108e55b71ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:08.830901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78f556-c63b-4246-b466-2108e55b71ed admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:08.834483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78f556-c63b-4246-b466-2108e55b71ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:08.834483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78f556-c63b-4246-b466-2108e55b71ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:08.858206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78f556-c63b-4246-b466-2108e55b71ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:08.859871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78f556-c63b-4246-b466-2108e55b71ed admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:08.886115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 837/1681] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:08.889948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec2d19-28ea-4544-a9cd-b54ff16b6c46 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:08.928717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec2d19-28ea-4544-a9cd-b54ff16b6c46 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:08.951368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bd74a-b08e-4190-9d79-c9406804022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:08.952298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bd74a-b08e-4190-9d79-c9406804022d admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:08.952584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bd74a-b08e-4190-9d79-c9406804022d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:08.958408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bd74a-b08e-4190-9d79-c9406804022d admin admin] PATH_INFO: `/v3/projects/25b68bc9254342068fef54877dfba966/users/39ea2326c02040e1811aacaad93a01f9/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:08.962416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bd74a-b08e-4190-9d79-c9406804022d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b68bc9254342068fef54877dfba966, user_id=39ea2326c02040e1811aacaad93a01f9, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:08.980214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bd74a-b08e-4190-9d79-c9406804022d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:09.026270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 845/1682] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:08 2022] PUT /identity/v3/projects/25b68bc9254342068fef54877dfba966/users/39ea2326c02040e1811aacaad93a01f9/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:09.037586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d6748-37fe-4d5e-bbb4-70b71765af80 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:09.038102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d6748-37fe-4d5e-bbb4-70b71765af80 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:09.038203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d6748-37fe-4d5e-bbb4-70b71765af80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:09.101093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-301d6748-37fe-4d5e-bbb4-70b71765af80 None None] MFA Rules not processed for user `39ea2326c02040e1811aacaad93a01f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:09.120858 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-301d6748-37fe-4d5e-bbb4-70b71765af80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:09.298376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bd74a-b08e-4190-9d79-c9406804022d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:09.300326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2e3bd74a-b08e-4190-9d79-c9406804022d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:09.355421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 838/1683] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:09.466101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d6748-37fe-4d5e-bbb4-70b71765af80 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:09.467972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-301d6748-37fe-4d5e-bbb4-70b71765af80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:09.563293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bd74a-b08e-4190-9d79-c9406804022d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:09.570038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d6748-37fe-4d5e-bbb4-70b71765af80 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:09.580865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdd15b-b48f-4751-a78e-496d48d94dbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:09.581630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdd15b-b48f-4751-a78e-496d48d94dbe service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:09.582106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdd15b-b48f-4751-a78e-496d48d94dbe service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:09.582574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdd15b-b48f-4751-a78e-496d48d94dbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:09.586360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fb826-81d5-4d98-bbd0-daf8b4e7743d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:09.587120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb826-81d5-4d98-bbd0-daf8b4e7743d service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:09.587435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb826-81d5-4d98-bbd0-daf8b4e7743d service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:09.587744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb826-81d5-4d98-bbd0-daf8b4e7743d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:09.600998 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fb826-81d5-4d98-bbd0-daf8b4e7743d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:09.602412 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fb826-81d5-4d98-bbd0-daf8b4e7743d service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:09.629651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 839/1684] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:09.787159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdd15b-b48f-4751-a78e-496d48d94dbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:09.789710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdd15b-b48f-4751-a78e-496d48d94dbe service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:09.816450 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 846/1685] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:38:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:38:09.988441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fb826-81d5-4d98-bbd0-daf8b4e7743d service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:09.999420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fb826-81d5-4d98-bbd0-daf8b4e7743d service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:10.016094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c69867-bb81-4c90-84dc-f228fb9beece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:10.016860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c69867-bb81-4c90-84dc-f228fb9beece service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:10.017152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c69867-bb81-4c90-84dc-f228fb9beece service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:10.017465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c69867-bb81-4c90-84dc-f228fb9beece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:10.208977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c69867-bb81-4c90-84dc-f228fb9beece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:10.210478 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c69867-bb81-4c90-84dc-f228fb9beece service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:10.281366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 840/1686] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:11.507035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd362339-5b5c-4fed-bcf5-a39eb2538272 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:11.507733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd362339-5b5c-4fed-bcf5-a39eb2538272 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:11.507733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd362339-5b5c-4fed-bcf5-a39eb2538272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:11.561168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-dd362339-5b5c-4fed-bcf5-a39eb2538272 None None] MFA Rules not processed for user `606b53c6f60d45cf9e2c3e5c6c9cde2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:11.562582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-dd362339-5b5c-4fed-bcf5-a39eb2538272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:11.712117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf1108-d6ad-4a30-ac52-0c41142f2a08 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:11.712688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf1108-d6ad-4a30-ac52-0c41142f2a08 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:11.712795 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf1108-d6ad-4a30-ac52-0c41142f2a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:11.761664 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f0bf1108-d6ad-4a30-ac52-0c41142f2a08 None None] MFA Rules not processed for user `2a2b95ccb7804311a011f37ccb371771`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:11.763443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f0bf1108-d6ad-4a30-ac52-0c41142f2a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:11.766076 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 847/1687] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:11.782038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd362339-5b5c-4fed-bcf5-a39eb2538272 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:11.784892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-dd362339-5b5c-4fed-bcf5-a39eb2538272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:11.985168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 841/1688] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:11.986242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf1108-d6ad-4a30-ac52-0c41142f2a08 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:11.989192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f0bf1108-d6ad-4a30-ac52-0c41142f2a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:12.015949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd362339-5b5c-4fed-bcf5-a39eb2538272 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:12.022462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550ba61-0c56-4197-9af5-299eb8ca50c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:12.025408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550ba61-0c56-4197-9af5-299eb8ca50c2 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:12.025408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550ba61-0c56-4197-9af5-299eb8ca50c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:12.025408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550ba61-0c56-4197-9af5-299eb8ca50c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:12.027027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf1108-d6ad-4a30-ac52-0c41142f2a08 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:12.042185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfcf6e-5b05-45c3-be1c-8cec48690c83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:12.046495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfcf6e-5b05-45c3-be1c-8cec48690c83 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:12.046749 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfcf6e-5b05-45c3-be1c-8cec48690c83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:12.047277 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfcf6e-5b05-45c3-be1c-8cec48690c83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:12.050865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550ba61-0c56-4197-9af5-299eb8ca50c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:12.052108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9bbfcf6e-5b05-45c3-be1c-8cec48690c83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:12.056266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550ba61-0c56-4197-9af5-299eb8ca50c2 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:12.090558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 848/1689] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:12.095446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f203c45-de0c-400a-b4e7-b77158255754 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:12.096066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f203c45-de0c-400a-b4e7-b77158255754 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:12.096499 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f203c45-de0c-400a-b4e7-b77158255754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:12.145504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8f203c45-de0c-400a-b4e7-b77158255754 None None] MFA Rules not processed for user `2a2b95ccb7804311a011f37ccb371771`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:12.148207 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8f203c45-de0c-400a-b4e7-b77158255754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:12.176532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 849/1690] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:12.203516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f203c45-de0c-400a-b4e7-b77158255754 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:12.245961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f203c45-de0c-400a-b4e7-b77158255754 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:12.255516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfcf6e-5b05-45c3-be1c-8cec48690c83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:12.258028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfcf6e-5b05-45c3-be1c-8cec48690c83 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:12.266661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4931-a913-440f-b4ee-cfb502903fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:12.279518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4931-a913-440f-b4ee-cfb502903fa6 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:12.280506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4931-a913-440f-b4ee-cfb502903fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:12.280506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4931-a913-440f-b4ee-cfb502903fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:12.312105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 842/1691] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:12.313251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d4931-a913-440f-b4ee-cfb502903fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:12.318584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d4931-a913-440f-b4ee-cfb502903fa6 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:12.370695 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfcf6e-5b05-45c3-be1c-8cec48690c83 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:12.374016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9bbfcf6e-5b05-45c3-be1c-8cec48690c83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:12.390400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 850/1692] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:12.706089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfcf6e-5b05-45c3-be1c-8cec48690c83 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:12.725863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:12.725863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:12.725863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:12.725863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] PATH_INFO: `/v3/users/c1a3d3e7ddef4a4fb859c52ceecb1b1e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:12.731194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a3d3e7ddef4a4fb859c52ceecb1b1e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:12.733623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:13.046517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a3d3e7ddef4a4fb859c52ceecb1b1e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:13.086116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a3d3e7ddef4a4fb859c52ceecb1b1e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:13.094724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a3d3e7ddef4a4fb859c52ceecb1b1e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:13.192496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a3d3e7ddef4a4fb859c52ceecb1b1e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:13.202473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a3d3e7ddef4a4fb859c52ceecb1b1e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:13.229610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887ac5b-1fd9-4cbf-9234-f1d2e0cba8a8 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:13.229610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887ac5b-1fd9-4cbf-9234-f1d2e0cba8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:13.229610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887ac5b-1fd9-4cbf-9234-f1d2e0cba8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:13.231896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 843/1693] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:12 2022] DELETE /identity/v3/users/c1a3d3e7ddef4a4fb859c52ceecb1b1e => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:13.291787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-2887ac5b-1fd9-4cbf-9234-f1d2e0cba8a8 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:13.294513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2887ac5b-1fd9-4cbf-9234-f1d2e0cba8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:13.465815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 851/1694] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:13.477918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:13.481449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:13.538979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47386-0f2c-4f7d-8755-6b36a119d4ea None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:13.539274 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47386-0f2c-4f7d-8755-6b36a119d4ea None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:13.539782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47386-0f2c-4f7d-8755-6b36a119d4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:13.577679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d6a47386-0f2c-4f7d-8755-6b36a119d4ea None None] MFA Rules not processed for user `4379d3e8b38645978efb08ea6f560fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:13.593845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d6a47386-0f2c-4f7d-8755-6b36a119d4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:13.602693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832809a-350f-47e0-b351-cf1a118858dc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:13.621500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b1285-2ba7-4b07-a14d-164219eace00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:13.622166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1285-2ba7-4b07-a14d-164219eace00 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:13.622457 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1285-2ba7-4b07-a14d-164219eace00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:13.622753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1285-2ba7-4b07-a14d-164219eace00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:13.625170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 852/1695] 10.222.0.48 () {58 vars in 1015 bytes} [Thu May 12 20:38:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:13.628800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062cb00-7fae-427b-8b9e-bbaabacfcebc None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:13.629091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062cb00-7fae-427b-8b9e-bbaabacfcebc None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:13.631135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062cb00-7fae-427b-8b9e-bbaabacfcebc None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:13.635673 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 853/1696] 10.222.0.59 () {54 vars in 912 bytes} [Thu May 12 20:38:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:38:13.642097 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5977cc6-fab7-4ee0-9bbc-bfa3c09dca4d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:13.642484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5977cc6-fab7-4ee0-9bbc-bfa3c09dca4d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:13.642979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5977cc6-fab7-4ee0-9bbc-bfa3c09dca4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:13.665748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b1285-2ba7-4b07-a14d-164219eace00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:13.670955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b1285-2ba7-4b07-a14d-164219eace00 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:13.707207 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 844/1697] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:13.712647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b1285-2ba7-4b07-a14d-164219eace00 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:13.717290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7c3b1285-2ba7-4b07-a14d-164219eace00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:13.752469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-b5977cc6-fab7-4ee0-9bbc-bfa3c09dca4d None None] MFA Rules not processed for user `4379d3e8b38645978efb08ea6f560fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:13.753755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b5977cc6-fab7-4ee0-9bbc-bfa3c09dca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:13.780262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b1285-2ba7-4b07-a14d-164219eace00 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:13.790414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f5853-950b-4612-aed0-896a1c366e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:13.793144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f5853-950b-4612-aed0-896a1c366e69 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:13.793144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f5853-950b-4612-aed0-896a1c366e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:13.793144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f5853-950b-4612-aed0-896a1c366e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:13.794318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 854/1698] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:38:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:13.842338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f5853-950b-4612-aed0-896a1c366e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:13.844205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f5853-950b-4612-aed0-896a1c366e69 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:13.871050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 845/1699] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:13.952066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5977cc6-fab7-4ee0-9bbc-bfa3c09dca4d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:13.962001 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5977cc6-fab7-4ee0-9bbc-bfa3c09dca4d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:13.980760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52fb2f-0f54-4d2d-aca7-825ad1f5d492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:13.982804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52fb2f-0f54-4d2d-aca7-825ad1f5d492 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:13.983102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52fb2f-0f54-4d2d-aca7-825ad1f5d492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:13.983385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52fb2f-0f54-4d2d-aca7-825ad1f5d492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:14.005822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52fb2f-0f54-4d2d-aca7-825ad1f5d492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:14.014593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52fb2f-0f54-4d2d-aca7-825ad1f5d492 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:14.033505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 855/1700] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:14.438742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f5853-950b-4612-aed0-896a1c366e69 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:14.440684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-198f5853-950b-4612-aed0-896a1c366e69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:14.494407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f5853-950b-4612-aed0-896a1c366e69 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:14.517200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:14.518371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:14.518908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:14.519378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] PATH_INFO: `/v3/users/ff746db0f04a408f9b3893e98b553ad2` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:14.522788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff746db0f04a408f9b3893e98b553ad2)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:14.534099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:14.893102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff746db0f04a408f9b3893e98b553ad2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:14.934419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff746db0f04a408f9b3893e98b553ad2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:14.937713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff746db0f04a408f9b3893e98b553ad2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:15.016471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff746db0f04a408f9b3893e98b553ad2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:15.029496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff746db0f04a408f9b3893e98b553ad2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:15.057138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8591-a30b-44cf-a95b-26d2b3ccde9c None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:15.057710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8591-a30b-44cf-a95b-26d2b3ccde9c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:15.057710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8591-a30b-44cf-a95b-26d2b3ccde9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:15.060545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 846/1701] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:14 2022] DELETE /identity/v3/users/ff746db0f04a408f9b3893e98b553ad2 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:15.133842 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-af7e8591-a30b-44cf-a95b-26d2b3ccde9c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:15.138370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-af7e8591-a30b-44cf-a95b-26d2b3ccde9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:15.343662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 856/1702] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:15.429718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:15.431432 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:15.434481 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e8591-a30b-44cf-a95b-26d2b3ccde9c None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:15.437451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-af7e8591-a30b-44cf-a95b-26d2b3ccde9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:15.507301 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f84881-855d-4bb8-bb21-d2ad37165e39 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:15.518541 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:15.519501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:15.519821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:15.520118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] PATH_INFO: `/v3/projects/3d2fc72d0ed540d3adcc66f456b0f5f6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:15.522881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2fc72d0ed540d3adcc66f456b0f5f6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:15.530464 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:15.687892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e8591-a30b-44cf-a95b-26d2b3ccde9c None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:15.701185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f4aa7-5576-415e-b48b-bfb563630a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:15.711921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f4aa7-5576-415e-b48b-bfb563630a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:15.712378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f4aa7-5576-415e-b48b-bfb563630a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:15.712717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f4aa7-5576-415e-b48b-bfb563630a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:15.752050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f4aa7-5576-415e-b48b-bfb563630a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:15.752856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f4aa7-5576-415e-b48b-bfb563630a6f service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:15.789942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 857/1703] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:38:15.903346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2fc72d0ed540d3adcc66f456b0f5f6', 'request_id': 'req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:15.946318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2fc72d0ed540d3adcc66f456b0f5f6', 'request_id': 'req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:16.072083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2fc72d0ed540d3adcc66f456b0f5f6', 'request_id': 'req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:16.102349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] The token cache is being invalidate because project 3d2fc72d0ed540d3adcc66f456b0f5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:16.114211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:16.116959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e22f5a4-d7b0-4777-8efa-c6f2f4df7a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:16.121912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 847/1704] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:15 2022] DELETE /identity/v3/projects/3d2fc72d0ed540d3adcc66f456b0f5f6 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:16.133353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f4aa7-5576-415e-b48b-bfb563630a6f service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:16.174673 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f4aa7-5576-415e-b48b-bfb563630a6f service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:16.326971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:16.328172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:16.329660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:16.330090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] PATH_INFO: `/v3/users/bd8702d1f59949debb487d686daf5fca` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:16.332984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8702d1f59949debb487d686daf5fca)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:16.341874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:16.602339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8702d1f59949debb487d686daf5fca'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:16.603044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8702d1f59949debb487d686daf5fca'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:16.603828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8702d1f59949debb487d686daf5fca'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:16.649397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8702d1f59949debb487d686daf5fca'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:16.667780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f196d638-b484-42b7-abad-267069e5fb02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8702d1f59949debb487d686daf5fca'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:16.694956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb60c8-5a43-4fe0-b734-d69f6dbe3053 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:16.695466 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb60c8-5a43-4fe0-b734-d69f6dbe3053 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:16.695883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb60c8-5a43-4fe0-b734-d69f6dbe3053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:16.718816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-94bb60c8-5a43-4fe0-b734-d69f6dbe3053 None None] MFA Rules not processed for user `2a2b95ccb7804311a011f37ccb371771`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:16.720308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-94bb60c8-5a43-4fe0-b734-d69f6dbe3053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:16.770754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 858/1705] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:16 2022] DELETE /identity/v3/users/bd8702d1f59949debb487d686daf5fca => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:16.801604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 848/1706] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:18.597162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893f4d-f67c-4aae-8cb8-5c2b4956821e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:18.598137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893f4d-f67c-4aae-8cb8-5c2b4956821e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:18.598620 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893f4d-f67c-4aae-8cb8-5c2b4956821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:18.648785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-c6893f4d-f67c-4aae-8cb8-5c2b4956821e None None] MFA Rules not processed for user `64ce721d7163430dbf31ffbbf28c2094`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:18.658987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c6893f4d-f67c-4aae-8cb8-5c2b4956821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:18.863868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 859/1707] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:18.994302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb60c8-5a43-4fe0-b734-d69f6dbe3053 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:18.997392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-94bb60c8-5a43-4fe0-b734-d69f6dbe3053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:19.044119 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb60c8-5a43-4fe0-b734-d69f6dbe3053 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:19.212233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:19.213397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:19.213825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:19.214244 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] PATH_INFO: `/v3/projects/7dc9e80addbc4f50b0f5fd2f33d9c243` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:19.223221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc9e80addbc4f50b0f5fd2f33d9c243)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:19.224683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:19.267253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6893f4d-f67c-4aae-8cb8-5c2b4956821e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:19.269156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c6893f4d-f67c-4aae-8cb8-5c2b4956821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:19.320294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6893f4d-f67c-4aae-8cb8-5c2b4956821e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:19.359507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:19.363099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:19.363394 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:19.363751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] PATH_INFO: `/v3/users/69c96e51e8274ddfbb04c703e133602e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:19.367586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c96e51e8274ddfbb04c703e133602e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:19.379039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:19.415380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc9e80addbc4f50b0f5fd2f33d9c243', 'request_id': 'req-3c920a02-ce6b-4bba-b416-89859c2cca9a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:19.422261 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc9e80addbc4f50b0f5fd2f33d9c243', 'request_id': 'req-3c920a02-ce6b-4bba-b416-89859c2cca9a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:19.567109 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc9e80addbc4f50b0f5fd2f33d9c243', 'request_id': 'req-3c920a02-ce6b-4bba-b416-89859c2cca9a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:19.589125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] The token cache is being invalidate because project 7dc9e80addbc4f50b0f5fd2f33d9c243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:19.589965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:19.591991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3c920a02-ce6b-4bba-b416-89859c2cca9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:19.594486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 849/1708] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:18 2022] DELETE /identity/v3/projects/7dc9e80addbc4f50b0f5fd2f33d9c243 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:19.600772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260a9f-8162-434a-a32d-5e23bfad19b6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:19.602347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260a9f-8162-434a-a32d-5e23bfad19b6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:19.602801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260a9f-8162-434a-a32d-5e23bfad19b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:19.656540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-50260a9f-8162-434a-a32d-5e23bfad19b6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:19.657804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-50260a9f-8162-434a-a32d-5e23bfad19b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:19.756098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c96e51e8274ddfbb04c703e133602e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:19.760666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c96e51e8274ddfbb04c703e133602e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:19.768573 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c96e51e8274ddfbb04c703e133602e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:19.819515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c96e51e8274ddfbb04c703e133602e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:19.841662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cdec2c1d-e8cc-495d-b842-1960eab79eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c96e51e8274ddfbb04c703e133602e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:19.856454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 850/1709] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:19.858688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595e64-4095-40af-93f0-7af988350c6a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:19.858992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595e64-4095-40af-93f0-7af988350c6a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:19.859278 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595e64-4095-40af-93f0-7af988350c6a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:19.860619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 851/1710] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 12 20:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:38:19.869390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153669ee-78fa-48d5-9f46-803bfeaad4db None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:19.869390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153669ee-78fa-48d5-9f46-803bfeaad4db None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:19.869390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153669ee-78fa-48d5-9f46-803bfeaad4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:19.892332 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-153669ee-78fa-48d5-9f46-803bfeaad4db None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:19.893979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-153669ee-78fa-48d5-9f46-803bfeaad4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:19.937242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 860/1711] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:19 2022] DELETE /identity/v3/users/69c96e51e8274ddfbb04c703e133602e => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:19.941186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1ea6e-fa3f-4eb6-a651-fa57c9c54dcc None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:19.942379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1ea6e-fa3f-4eb6-a651-fa57c9c54dcc None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:19.943082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 852/1712] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:19.944191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1ea6e-fa3f-4eb6-a651-fa57c9c54dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:19.961099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81a712-33e0-4e45-813f-37a116b851d9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:19.966931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81a712-33e0-4e45-813f-37a116b851d9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:19.966931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81a712-33e0-4e45-813f-37a116b851d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:19.993480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-1da1ea6e-fa3f-4eb6-a651-fa57c9c54dcc None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:19.994197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1da1ea6e-fa3f-4eb6-a651-fa57c9c54dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:20.018100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-dc81a712-33e0-4e45-813f-37a116b851d9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:20.024197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-dc81a712-33e0-4e45-813f-37a116b851d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:20.165386 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 853/1713] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:20.169150 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81a712-33e0-4e45-813f-37a116b851d9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:20.199802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81a712-33e0-4e45-813f-37a116b851d9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:20.225198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58545a7-1809-4eda-8e56-0ed63f2dfc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:20.226859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58545a7-1809-4eda-8e56-0ed63f2dfc45 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:20.231054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 861/1714] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 12 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:20.244201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1ea6e-fa3f-4eb6-a651-fa57c9c54dcc None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:20.249007 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1da1ea6e-fa3f-4eb6-a651-fa57c9c54dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:20.250824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58545a7-1809-4eda-8e56-0ed63f2dfc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:20.251878 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58545a7-1809-4eda-8e56-0ed63f2dfc45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:20.256824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58545a7-1809-4eda-8e56-0ed63f2dfc45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:38:20.257556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58545a7-1809-4eda-8e56-0ed63f2dfc45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:20.265580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58545a7-1809-4eda-8e56-0ed63f2dfc45 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:20.284451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 854/1715] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:38:20.285773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58545a7-1809-4eda-8e56-0ed63f2dfc45 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:20.291523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c58545a7-1809-4eda-8e56-0ed63f2dfc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:20.294465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1ea6e-fa3f-4eb6-a651-fa57c9c54dcc None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:20.305843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:20.305843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:20.305843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:20.305843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] PATH_INFO: `/v3/projects/674a488f8524409bbf1b188ce73d3ee5` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:20.311324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674a488f8524409bbf1b188ce73d3ee5)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:20.318106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:20.442246 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58545a7-1809-4eda-8e56-0ed63f2dfc45 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:20.452653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5bfd5-bf33-4b18-a2b6-988122c7b90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:20.453386 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bfd5-bf33-4b18-a2b6-988122c7b90f service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:20.453865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bfd5-bf33-4b18-a2b6-988122c7b90f service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:20.454313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bfd5-bf33-4b18-a2b6-988122c7b90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:20.491501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5bfd5-bf33-4b18-a2b6-988122c7b90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:20.493693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5bfd5-bf33-4b18-a2b6-988122c7b90f service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:20.545566 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 855/1716] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:20.546450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5bfd5-bf33-4b18-a2b6-988122c7b90f service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:20.562184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674a488f8524409bbf1b188ce73d3ee5', 'request_id': 'req-e7c706e2-16f5-401c-99eb-e02f4c5104e6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:20.575987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5bfd5-bf33-4b18-a2b6-988122c7b90f service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:20.577782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674a488f8524409bbf1b188ce73d3ee5', 'request_id': 'req-e7c706e2-16f5-401c-99eb-e02f4c5104e6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:20.671731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674a488f8524409bbf1b188ce73d3ee5', 'request_id': 'req-e7c706e2-16f5-401c-99eb-e02f4c5104e6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:20.700689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] The token cache is being invalidate because project 674a488f8524409bbf1b188ce73d3ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:20.705934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:20.709836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:20.717115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 862/1717] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:20 2022] DELETE /identity/v3/projects/674a488f8524409bbf1b188ce73d3ee5 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:20.718668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:20.721981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:20.796694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf08b8-2be3-4b22-bc71-e5042c8a6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:20.797414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf08b8-2be3-4b22-bc71-e5042c8a6259 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:20.797708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf08b8-2be3-4b22-bc71-e5042c8a6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:20.797992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf08b8-2be3-4b22-bc71-e5042c8a6259 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:20.798703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf08b8-2be3-4b22-bc71-e5042c8a6259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:20.801580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf08b8-2be3-4b22-bc71-e5042c8a6259 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:20.957695 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 856/1718] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:20 2022] POST /identity/v3/projects => generated 373 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:20.962066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62704a-2ea5-4d98-bec5-b9242ca326b2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:20.962861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62704a-2ea5-4d98-bec5-b9242ca326b2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:20.962861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62704a-2ea5-4d98-bec5-b9242ca326b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:21.025604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c706e2-16f5-401c-99eb-e02f4c5104e6 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:21.035389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2c62704a-2ea5-4d98-bec5-b9242ca326b2 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:21.036704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2c62704a-2ea5-4d98-bec5-b9242ca326b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:21.163452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 857/1719] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:21.163452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9f65-26d2-4f7f-b39e-6bdbce24e30c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:21.163452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9f65-26d2-4f7f-b39e-6bdbce24e30c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:21.163452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9f65-26d2-4f7f-b39e-6bdbce24e30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:21.191453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e0aa9f65-26d2-4f7f-b39e-6bdbce24e30c None None] MFA Rules not processed for user `606b53c6f60d45cf9e2c3e5c6c9cde2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:21.193078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a60c5d-41f3-413f-9d83-caccafb758c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:21.193333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e0aa9f65-26d2-4f7f-b39e-6bdbce24e30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:21.194335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a60c5d-41f3-413f-9d83-caccafb758c0 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:21.194869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a60c5d-41f3-413f-9d83-caccafb758c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:21.195334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a60c5d-41f3-413f-9d83-caccafb758c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:21.198218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b4a60c5d-41f3-413f-9d83-caccafb758c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:21.214259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a60c5d-41f3-413f-9d83-caccafb758c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:21.217252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a60c5d-41f3-413f-9d83-caccafb758c0 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:21.249973 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 863/1720] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:21.258923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a60c5d-41f3-413f-9d83-caccafb758c0 service nova] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:21.266659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b4a60c5d-41f3-413f-9d83-caccafb758c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:21.310290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a60c5d-41f3-413f-9d83-caccafb758c0 service nova] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:21.330028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31adff7-0886-4fa1-bbb8-a3b18dbb72b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:21.330740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31adff7-0886-4fa1-bbb8-a3b18dbb72b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:21.331028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31adff7-0886-4fa1-bbb8-a3b18dbb72b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:21.331309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31adff7-0886-4fa1-bbb8-a3b18dbb72b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:21.332071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31adff7-0886-4fa1-bbb8-a3b18dbb72b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:21.333975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31adff7-0886-4fa1-bbb8-a3b18dbb72b1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:21.416196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 858/1721] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:21.417700 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3a678-67d4-469f-82d8-d7fc46bb4dbb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:21.418040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3a678-67d4-469f-82d8-d7fc46bb4dbb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:21.418410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3a678-67d4-469f-82d8-d7fc46bb4dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:21.443400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 864/1722] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:21 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:21.448127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31adff7-0886-4fa1-bbb8-a3b18dbb72b1 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:21.507987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31adff7-0886-4fa1-bbb8-a3b18dbb72b1 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:21.525742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e1e3a678-67d4-469f-82d8-d7fc46bb4dbb None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:21.526973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e1e3a678-67d4-469f-82d8-d7fc46bb4dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:21.538570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1a07a-8122-4c2c-9e66-0619a9803afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:21.539307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1a07a-8122-4c2c-9e66-0619a9803afd admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:21.539613 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1a07a-8122-4c2c-9e66-0619a9803afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:21.540383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1a07a-8122-4c2c-9e66-0619a9803afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:21.540689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1a07a-8122-4c2c-9e66-0619a9803afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:21.542346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1a07a-8122-4c2c-9e66-0619a9803afd admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:21.575667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 859/1723] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:21.576588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3a678-67d4-469f-82d8-d7fc46bb4dbb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:21.577924 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 865/1724] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:21.582756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1a07a-8122-4c2c-9e66-0619a9803afd admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:21.582882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e1e3a678-67d4-469f-82d8-d7fc46bb4dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:21.632328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1a07a-8122-4c2c-9e66-0619a9803afd admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:21.644310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3a678-67d4-469f-82d8-d7fc46bb4dbb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:21.660324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ce171-ea3b-4db1-a610-66959e849bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:21.661120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ce171-ea3b-4db1-a610-66959e849bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:21.661481 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ce171-ea3b-4db1-a610-66959e849bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:21.661770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ce171-ea3b-4db1-a610-66959e849bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:21.662577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ce171-ea3b-4db1-a610-66959e849bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:38:21.662897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ce171-ea3b-4db1-a610-66959e849bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:21.664685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ce171-ea3b-4db1-a610-66959e849bb0 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:21.666828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:21.669814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:21.671980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:21.672413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] PATH_INFO: `/v3/projects/a62555d4a0cd47a7808916c542ceebda` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:21.679557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62555d4a0cd47a7808916c542ceebda)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:21.688898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:21.754695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 866/1725] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:38:21.761244 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ce171-ea3b-4db1-a610-66959e849bb0 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:21.824490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ce171-ea3b-4db1-a610-66959e849bb0 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:21.826621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa66ae-6378-454e-917d-bc4c2aeb0807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:21.827553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa66ae-6378-454e-917d-bc4c2aeb0807 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:21.828001 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa66ae-6378-454e-917d-bc4c2aeb0807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:21.828473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa66ae-6378-454e-917d-bc4c2aeb0807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:21.829360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa66ae-6378-454e-917d-bc4c2aeb0807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:21.849599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa66ae-6378-454e-917d-bc4c2aeb0807 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:21.892229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 867/1726] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:21.896628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa66ae-6378-454e-917d-bc4c2aeb0807 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:21.946791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa66ae-6378-454e-917d-bc4c2aeb0807 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:21.986630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a3242-9217-4c34-aaaa-3a01c967e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:21.998067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a3242-9217-4c34-aaaa-3a01c967e493 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:22.001804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a3242-9217-4c34-aaaa-3a01c967e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:22.002344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a3242-9217-4c34-aaaa-3a01c967e493 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:22.003228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a3242-9217-4c34-aaaa-3a01c967e493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:22.005532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a3242-9217-4c34-aaaa-3a01c967e493 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:22.017145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62555d4a0cd47a7808916c542ceebda', 'request_id': 'req-84716665-e8eb-4f7d-82cb-22c3e9d105d0'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:22.041196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62555d4a0cd47a7808916c542ceebda', 'request_id': 'req-84716665-e8eb-4f7d-82cb-22c3e9d105d0'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:22.159912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62555d4a0cd47a7808916c542ceebda', 'request_id': 'req-84716665-e8eb-4f7d-82cb-22c3e9d105d0'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:22.193308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] The token cache is being invalidate because project a62555d4a0cd47a7808916c542ceebda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:22.193702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:22.196272 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:22.202532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 860/1727] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:21 2022] DELETE /identity/v3/projects/a62555d4a0cd47a7808916c542ceebda => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:22.205903 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:22.222426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 868/1728] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:21 2022] POST /identity/v3/projects => generated 367 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:22.222426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a3242-9217-4c34-aaaa-3a01c967e493 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:22.223009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:22.225808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-211a3242-9217-4c34-aaaa-3a01c967e493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:22.493762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a3242-9217-4c34-aaaa-3a01c967e493 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:22.499363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84716665-e8eb-4f7d-82cb-22c3e9d105d0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:22.506531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b32a3-3e76-4f67-899a-9bd070bc017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:22.510615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:22.510615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:22.510818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b32a3-3e76-4f67-899a-9bd070bc017f admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:22.510892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:22.510958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b32a3-3e76-4f67-899a-9bd070bc017f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:22.511055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] PATH_INFO: `/v3/users/b035442ab1b34be599d9c6bdc9568593` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:22.511124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b32a3-3e76-4f67-899a-9bd070bc017f admin admin] PATH_INFO: `/v3/projects/8cf46310631c484790071f4ff000748e/users/4cc761d6dde14282b0c6ddb70ef90ee4/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:22.511199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b035442ab1b34be599d9c6bdc9568593)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:22.513444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:22.563558 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b32a3-3e76-4f67-899a-9bd070bc017f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf46310631c484790071f4ff000748e, user_id=4cc761d6dde14282b0c6ddb70ef90ee4, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:22.566351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b32a3-3e76-4f67-899a-9bd070bc017f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:22.631638 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 861/1729] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:22 2022] PUT /identity/v3/projects/8cf46310631c484790071f4ff000748e/users/4cc761d6dde14282b0c6ddb70ef90ee4/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:22.632825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b32a3-3e76-4f67-899a-9bd070bc017f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:22.654003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ef7b32a3-3e76-4f67-899a-9bd070bc017f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:22.726156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b035442ab1b34be599d9c6bdc9568593'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:22.733824 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b035442ab1b34be599d9c6bdc9568593'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:22.741792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b035442ab1b34be599d9c6bdc9568593'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:22.770884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b035442ab1b34be599d9c6bdc9568593'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:22.800954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3c980be-7741-45d5-90af-54ade24f986c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b035442ab1b34be599d9c6bdc9568593'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:22.846582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b32a3-3e76-4f67-899a-9bd070bc017f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:22.856533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807d3d5-12ee-4f1d-8350-9230d6db8b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:22.864620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807d3d5-12ee-4f1d-8350-9230d6db8b80 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:22.864620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807d3d5-12ee-4f1d-8350-9230d6db8b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:22.864786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807d3d5-12ee-4f1d-8350-9230d6db8b80 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:22.867853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807d3d5-12ee-4f1d-8350-9230d6db8b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:22.873003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807d3d5-12ee-4f1d-8350-9230d6db8b80 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:22.882792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 869/1730] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:22 2022] DELETE /identity/v3/users/b035442ab1b34be599d9c6bdc9568593 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:22.884283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc783a3d-01f8-4ae1-96e2-a53450a70c2e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:22.884966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc783a3d-01f8-4ae1-96e2-a53450a70c2e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:22.885186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc783a3d-01f8-4ae1-96e2-a53450a70c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:23.003074 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-cc783a3d-01f8-4ae1-96e2-a53450a70c2e None None] MFA Rules not processed for user `4cc761d6dde14282b0c6ddb70ef90ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:23.006314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-cc783a3d-01f8-4ae1-96e2-a53450a70c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:23.032754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 862/1731] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:22 2022] POST /identity/v3/users => generated 284 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:23.044207 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807d3d5-12ee-4f1d-8350-9230d6db8b80 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:23.047040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1807d3d5-12ee-4f1d-8350-9230d6db8b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:23.066835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807d3d5-12ee-4f1d-8350-9230d6db8b80 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:23.125301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 870/1732] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:23.266625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9803408-6388-41cd-83f3-907e640e3f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:23.268244 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9803408-6388-41cd-83f3-907e640e3f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:23.269647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9803408-6388-41cd-83f3-907e640e3f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:23.270681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9803408-6388-41cd-83f3-907e640e3f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:23.273384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9803408-6388-41cd-83f3-907e640e3f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:23.276043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9803408-6388-41cd-83f3-907e640e3f9a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:23.308687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 863/1733] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:23.310390 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc783a3d-01f8-4ae1-96e2-a53450a70c2e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:23.327290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc783a3d-01f8-4ae1-96e2-a53450a70c2e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:23.338921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481514c-2dd7-46b3-943d-359287169f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:23.339617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481514c-2dd7-46b3-943d-359287169f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:23.340557 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481514c-2dd7-46b3-943d-359287169f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:23.340869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481514c-2dd7-46b3-943d-359287169f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:23.341680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481514c-2dd7-46b3-943d-359287169f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:23.343396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481514c-2dd7-46b3-943d-359287169f60 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:23.375701 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 871/1734] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:23.380117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9803408-6388-41cd-83f3-907e640e3f9a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:23.397487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9803408-6388-41cd-83f3-907e640e3f9a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:23.411719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe2180-d74c-4dd7-97d8-efe0e8cbdc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:23.413813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2180-d74c-4dd7-97d8-efe0e8cbdc41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:23.414087 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2180-d74c-4dd7-97d8-efe0e8cbdc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:23.415905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe2180-d74c-4dd7-97d8-efe0e8cbdc41 admin admin] PATH_INFO: `/v3/projects/6c2ccc998d5f486889e3bdf5e09f8177/users/35ec1ba18f4a42318d2ac77920d01d88/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:23.442616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481514c-2dd7-46b3-943d-359287169f60 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:23.445002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a481514c-2dd7-46b3-943d-359287169f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:23.460937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe2180-d74c-4dd7-97d8-efe0e8cbdc41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2ccc998d5f486889e3bdf5e09f8177, user_id=35ec1ba18f4a42318d2ac77920d01d88, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:23.469967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe2180-d74c-4dd7-97d8-efe0e8cbdc41 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:23.597705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 864/1735] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:23 2022] PUT /identity/v3/projects/6c2ccc998d5f486889e3bdf5e09f8177/users/35ec1ba18f4a42318d2ac77920d01d88/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:38:23.609677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85aa61-0b75-4fd1-80cc-72070b2298d5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:23.610180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85aa61-0b75-4fd1-80cc-72070b2298d5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:23.610555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85aa61-0b75-4fd1-80cc-72070b2298d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:23.639466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481514c-2dd7-46b3-943d-359287169f60 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:23.649130 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8f85aa61-0b75-4fd1-80cc-72070b2298d5 None None] MFA Rules not processed for user `35ec1ba18f4a42318d2ac77920d01d88`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:23.651022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8f85aa61-0b75-4fd1-80cc-72070b2298d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:23.770052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ff9fa-560c-443e-b931-ca6d54e143a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:23.770851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ff9fa-560c-443e-b931-ca6d54e143a8 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:23.771013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ff9fa-560c-443e-b931-ca6d54e143a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:23.771266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ff9fa-560c-443e-b931-ca6d54e143a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:23.823803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 865/1736] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:23.830957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85aa61-0b75-4fd1-80cc-72070b2298d5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:23.957971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ff9fa-560c-443e-b931-ca6d54e143a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:23.960400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ff9fa-560c-443e-b931-ca6d54e143a8 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:23.993784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 872/1737] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:38:24.055433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85aa61-0b75-4fd1-80cc-72070b2298d5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:24.062356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d3d1e-affa-4d4c-84b8-9a8961bf8e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:24.063505 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d3d1e-affa-4d4c-84b8-9a8961bf8e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:24.063795 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d3d1e-affa-4d4c-84b8-9a8961bf8e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:24.064164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d3d1e-affa-4d4c-84b8-9a8961bf8e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:24.064869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d3d1e-affa-4d4c-84b8-9a8961bf8e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:24.067035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d3d1e-affa-4d4c-84b8-9a8961bf8e7a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:24.226262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ff9fa-560c-443e-b931-ca6d54e143a8 service nova] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:24.235264 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 866/1738] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:23 2022] POST /identity/v3/projects => generated 367 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:24.260962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ff9fa-560c-443e-b931-ca6d54e143a8 service nova] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:24.462638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad961457-d726-41b9-9faf-3020b5883f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:24.465739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad961457-d726-41b9-9faf-3020b5883f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:24.466285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad961457-d726-41b9-9faf-3020b5883f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:24.473636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad961457-d726-41b9-9faf-3020b5883f8c admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:24.473636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad961457-d726-41b9-9faf-3020b5883f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:24.476183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad961457-d726-41b9-9faf-3020b5883f8c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:24.629350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 873/1739] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:24 2022] POST /identity/v3/users => generated 290 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:38:24.633204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d3d1e-affa-4d4c-84b8-9a8961bf8e7a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:24.673594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d3d1e-affa-4d4c-84b8-9a8961bf8e7a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:24.696851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6db91e-750e-45e6-88bc-fa7128258714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:24.700014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6db91e-750e-45e6-88bc-fa7128258714 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:24.700776 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6db91e-750e-45e6-88bc-fa7128258714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:24.701395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6db91e-750e-45e6-88bc-fa7128258714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:24.702407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6db91e-750e-45e6-88bc-fa7128258714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:24.705470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6db91e-750e-45e6-88bc-fa7128258714 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:24.752730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 867/1740] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:24.757129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad961457-d726-41b9-9faf-3020b5883f8c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:24.768863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad961457-d726-41b9-9faf-3020b5883f8c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:24.785127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f555972-62f4-4b62-af06-9222dd345b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:24.791816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555972-62f4-4b62-af06-9222dd345b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:24.791816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555972-62f4-4b62-af06-9222dd345b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:24.791816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555972-62f4-4b62-af06-9222dd345b5b admin admin] PATH_INFO: `/v3/projects/541f194012c84e23ab694af7073297b9/users/783470026750457c88b6916f8d313bbc/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:24.844991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f555972-62f4-4b62-af06-9222dd345b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=541f194012c84e23ab694af7073297b9, user_id=783470026750457c88b6916f8d313bbc, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:24.848407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f555972-62f4-4b62-af06-9222dd345b5b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:24.959637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 874/1741] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:24 2022] PUT /identity/v3/projects/541f194012c84e23ab694af7073297b9/users/783470026750457c88b6916f8d313bbc/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:24.962526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6db91e-750e-45e6-88bc-fa7128258714 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:24.976905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6db91e-750e-45e6-88bc-fa7128258714 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:25.036737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f555972-62f4-4b62-af06-9222dd345b5b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:25.039286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1f555972-62f4-4b62-af06-9222dd345b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:25.172286 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7efc-8856-444b-b685-0f95cb798dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:25.176720 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7efc-8856-444b-b685-0f95cb798dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:25.177144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7efc-8856-444b-b685-0f95cb798dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:25.177682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c7efc-8856-444b-b685-0f95cb798dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:25.181852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c7efc-8856-444b-b685-0f95cb798dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:25.186322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c7efc-8856-444b-b685-0f95cb798dbf admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:25.214651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f555972-62f4-4b62-af06-9222dd345b5b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:25.219293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 868/1742] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:25.243422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:25.246884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:25.246884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:25.246884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] PATH_INFO: `/v3/projects/67c79006ecd6400881521d789a697513` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:25.249537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7efc-8856-444b-b685-0f95cb798dbf admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:25.250186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c79006ecd6400881521d789a697513)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:25.261734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:25.292545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c7efc-8856-444b-b685-0f95cb798dbf admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:25.322900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cda088-7200-4276-8276-7506981975e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:25.325939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda088-7200-4276-8276-7506981975e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:25.326854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda088-7200-4276-8276-7506981975e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:25.327559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda088-7200-4276-8276-7506981975e6 admin admin] PATH_INFO: `/v3/projects/541f194012c84e23ab694af7073297b9/users/783470026750457c88b6916f8d313bbc/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:25.361152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cda088-7200-4276-8276-7506981975e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=541f194012c84e23ab694af7073297b9, user_id=783470026750457c88b6916f8d313bbc, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:25.374645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cda088-7200-4276-8276-7506981975e6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:25.438972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 869/1743] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:25 2022] PUT /identity/v3/projects/541f194012c84e23ab694af7073297b9/users/783470026750457c88b6916f8d313bbc/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:25.473061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0de107-2137-4584-88e7-5045c54dbe36 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:25.473741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0de107-2137-4584-88e7-5045c54dbe36 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:25.474037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0de107-2137-4584-88e7-5045c54dbe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:25.577442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4c0de107-2137-4584-88e7-5045c54dbe36 None None] MFA Rules not processed for user `783470026750457c88b6916f8d313bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:25.579895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4c0de107-2137-4584-88e7-5045c54dbe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:25.750067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 870/1744] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:25.752159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0de107-2137-4584-88e7-5045c54dbe36 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:25.755964 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4c0de107-2137-4584-88e7-5045c54dbe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:25.789517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c79006ecd6400881521d789a697513', 'request_id': 'req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:25.802989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c79006ecd6400881521d789a697513', 'request_id': 'req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:25.894279 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c79006ecd6400881521d789a697513', 'request_id': 'req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:25.915671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] The token cache is being invalidate because project 67c79006ecd6400881521d789a697513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:25.917210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:25.924348 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:25.929190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 875/1745] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:25 2022] DELETE /identity/v3/projects/67c79006ecd6400881521d789a697513 => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:38:25.932226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:25.943567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:25.943695 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0de107-2137-4584-88e7-5045c54dbe36 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:26.051942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eaa52-0fd4-44f3-85ce-a00b22ee87fa admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:26.060541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edf17e-d3c8-4887-971e-b14ea6b790d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:26.061639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edf17e-d3c8-4887-971e-b14ea6b790d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:26.063030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edf17e-d3c8-4887-971e-b14ea6b790d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:26.063920 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edf17e-d3c8-4887-971e-b14ea6b790d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:26.067344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-13edf17e-d3c8-4887-971e-b14ea6b790d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:26.214202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:26.219445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:26.219707 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:26.224515 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] PATH_INFO: `/v3/users/4cc761d6dde14282b0c6ddb70ef90ee4` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:26.228929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc761d6dde14282b0c6ddb70ef90ee4)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:26.240527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edf17e-d3c8-4887-971e-b14ea6b790d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:26.255127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edf17e-d3c8-4887-971e-b14ea6b790d6 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:26.272645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:26.303887 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 876/1746] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:26.307508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edf17e-d3c8-4887-971e-b14ea6b790d6 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:26.313663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-13edf17e-d3c8-4887-971e-b14ea6b790d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:26.374895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edf17e-d3c8-4887-971e-b14ea6b790d6 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:26.396546 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:26.415754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:26.416305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:26.419532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] PATH_INFO: `/v3/users/d0ec8b32352f4a85a17095c8fb4ed7ea` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:26.421738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ec8b32352f4a85a17095c8fb4ed7ea)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:26.431235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:26.740556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc761d6dde14282b0c6ddb70ef90ee4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:26.770360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc761d6dde14282b0c6ddb70ef90ee4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:26.770633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc761d6dde14282b0c6ddb70ef90ee4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:26.810057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ec8b32352f4a85a17095c8fb4ed7ea'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:26.826532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ec8b32352f4a85a17095c8fb4ed7ea'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:26.830898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ec8b32352f4a85a17095c8fb4ed7ea'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:26.860300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc761d6dde14282b0c6ddb70ef90ee4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:26.872918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc761d6dde14282b0c6ddb70ef90ee4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:26.878798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ec8b32352f4a85a17095c8fb4ed7ea'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:26.893658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 871/1747] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:25 2022] DELETE /identity/v3/users/4cc761d6dde14282b0c6ddb70ef90ee4 => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:26.897739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:26.899289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:26.903930 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-749d5c01-2866-4f58-822e-6e89ab49ba65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ec8b32352f4a85a17095c8fb4ed7ea'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:26.997605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 877/1748] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:26 2022] DELETE /identity/v3/users/d0ec8b32352f4a85a17095c8fb4ed7ea => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:26.999361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd12af-83d8-4e3c-b70c-2d6395eedd32 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:26.999822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd12af-83d8-4e3c-b70c-2d6395eedd32 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:27.000636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd12af-83d8-4e3c-b70c-2d6395eedd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:27.009568 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdc5dc-9975-42d9-96f8-80d780578b8e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:27.024516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-c4fd12af-83d8-4e3c-b70c-2d6395eedd32 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:27.025699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c4fd12af-83d8-4e3c-b70c-2d6395eedd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:27.099774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5faf-fba5-42ef-9a04-f4d1c4c74a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:27.100564 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5faf-fba5-42ef-9a04-f4d1c4c74a60 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:27.100916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5faf-fba5-42ef-9a04-f4d1c4c74a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:27.101526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5faf-fba5-42ef-9a04-f4d1c4c74a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:27.104273 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a2bd5faf-fba5-42ef-9a04-f4d1c4c74a60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:27.118319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 878/1749] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:27.177252 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd5faf-fba5-42ef-9a04-f4d1c4c74a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:27.179337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd5faf-fba5-42ef-9a04-f4d1c4c74a60 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:27.191611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 872/1750] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:27.205149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd12af-83d8-4e3c-b70c-2d6395eedd32 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:27.206646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c4fd12af-83d8-4e3c-b70c-2d6395eedd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:27.313123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd12af-83d8-4e3c-b70c-2d6395eedd32 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:27.317797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9a10f-8700-4681-a9a5-1699c3d3eb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:27.318509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9a10f-8700-4681-a9a5-1699c3d3eb49 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:27.318809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9a10f-8700-4681-a9a5-1699c3d3eb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:27.319090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9a10f-8700-4681-a9a5-1699c3d3eb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:27.337764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9a10f-8700-4681-a9a5-1699c3d3eb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:27.339287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9a10f-8700-4681-a9a5-1699c3d3eb49 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:27.364083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 879/1751] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:28.368635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5faf-fba5-42ef-9a04-f4d1c4c74a60 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:28.372742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a2bd5faf-fba5-42ef-9a04-f4d1c4c74a60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:28.397792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9a10f-8700-4681-a9a5-1699c3d3eb49 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:28.399243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6de9a10f-8700-4681-a9a5-1699c3d3eb49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:28.410365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5faf-fba5-42ef-9a04-f4d1c4c74a60 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:28.418429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:28.419313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:28.419599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:28.419882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] PATH_INFO: `/v3/projects/e9afca365b8f4da5968f47120d9c5fe7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:28.420974 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9a10f-8700-4681-a9a5-1699c3d3eb49 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:28.421372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9afca365b8f4da5968f47120d9c5fe7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:28.428185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:28.428502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:28.429423 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:28.429911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:28.430405 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] PATH_INFO: `/v3/projects/8cf46310631c484790071f4ff000748e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:28.432955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf46310631c484790071f4ff000748e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:28.437533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:28.649459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf46310631c484790071f4ff000748e', 'request_id': 'req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:28.659105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf46310631c484790071f4ff000748e', 'request_id': 'req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:28.678985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9afca365b8f4da5968f47120d9c5fe7', 'request_id': 'req-b6affcb2-e689-45cc-a771-c78abb9b8393'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:28.686868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9afca365b8f4da5968f47120d9c5fe7', 'request_id': 'req-b6affcb2-e689-45cc-a771-c78abb9b8393'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:28.784514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf46310631c484790071f4ff000748e', 'request_id': 'req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:28.797058 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] The token cache is being invalidate because project 8cf46310631c484790071f4ff000748e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:28.797453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:28.798163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8f60ee28-bdc4-48fe-87e6-ddb9eba57f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:28.799906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 880/1752] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:28 2022] DELETE /identity/v3/projects/8cf46310631c484790071f4ff000748e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:28.802638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dbf6a-a000-44e4-9bbd-a3b6899b9058 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:28.802997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dbf6a-a000-44e4-9bbd-a3b6899b9058 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:28.803384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dbf6a-a000-44e4-9bbd-a3b6899b9058 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:28.804749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 881/1753] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 12 20:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:38:28.805830 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c2c2b-653f-4708-aeb3-4be5a0044d21 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:28.806120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c2c2b-653f-4708-aeb3-4be5a0044d21 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:28.806398 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c2c2b-653f-4708-aeb3-4be5a0044d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:28.837768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-7f2c2c2b-653f-4708-aeb3-4be5a0044d21 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:28.839915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7f2c2c2b-653f-4708-aeb3-4be5a0044d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:28.895009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9afca365b8f4da5968f47120d9c5fe7', 'request_id': 'req-b6affcb2-e689-45cc-a771-c78abb9b8393'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:28.913725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] The token cache is being invalidate because project e9afca365b8f4da5968f47120d9c5fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:28.914400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:28.915398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b6affcb2-e689-45cc-a771-c78abb9b8393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:28.923489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 873/1754] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:28 2022] DELETE /identity/v3/projects/e9afca365b8f4da5968f47120d9c5fe7 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:28.926453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 882/1755] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:28.932268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd623da-3eb2-42ca-bb8d-3df15abdc306 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:28.932268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd623da-3eb2-42ca-bb8d-3df15abdc306 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:28.932268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd623da-3eb2-42ca-bb8d-3df15abdc306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:28.932498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826ef2f-2e7d-471d-8d57-416a2ddc0b90 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:28.932498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826ef2f-2e7d-471d-8d57-416a2ddc0b90 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:28.932498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826ef2f-2e7d-471d-8d57-416a2ddc0b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:28.947758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3fd623da-3eb2-42ca-bb8d-3df15abdc306 None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:28.948985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3fd623da-3eb2-42ca-bb8d-3df15abdc306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:28.968314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-3826ef2f-2e7d-471d-8d57-416a2ddc0b90 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:28.970730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3826ef2f-2e7d-471d-8d57-416a2ddc0b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:28.988833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 883/1756] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:28.988833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1cfe1-1fe0-465a-8d8b-b57611a69db8 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:28.988833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1cfe1-1fe0-465a-8d8b-b57611a69db8 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:28.989179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1cfe1-1fe0-465a-8d8b-b57611a69db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.030788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-c0a1cfe1-1fe0-465a-8d8b-b57611a69db8 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:29.032233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c0a1cfe1-1fe0-465a-8d8b-b57611a69db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:29.044813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 884/1757] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:29.046597 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf9f57-c63f-4a32-bebe-dd87879f2945 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.047106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf9f57-c63f-4a32-bebe-dd87879f2945 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.047624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf9f57-c63f-4a32-bebe-dd87879f2945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.072339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-2caf9f57-c63f-4a32-bebe-dd87879f2945 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:29.073726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2caf9f57-c63f-4a32-bebe-dd87879f2945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:29.081129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 874/1758] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 12 20:38:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:29.082345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd623da-3eb2-42ca-bb8d-3df15abdc306 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.083951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 885/1759] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:29.094401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf9f57-c63f-4a32-bebe-dd87879f2945 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.098417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd623da-3eb2-42ca-bb8d-3df15abdc306 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.104455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf9f57-c63f-4a32-bebe-dd87879f2945 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.105429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c20fd2-daaf-4a2c-a707-74af09671d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.107051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c20fd2-daaf-4a2c-a707-74af09671d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.107435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c20fd2-daaf-4a2c-a707-74af09671d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.107819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c20fd2-daaf-4a2c-a707-74af09671d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.108668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c20fd2-daaf-4a2c-a707-74af09671d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:38:29.109085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c20fd2-daaf-4a2c-a707-74af09671d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.126021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452009da-7c82-45e0-aadd-92fb271bcba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.127833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c20fd2-daaf-4a2c-a707-74af09671d57 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:29.155772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 875/1760] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:38:29.155958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452009da-7c82-45e0-aadd-92fb271bcba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.156057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c20fd2-daaf-4a2c-a707-74af09671d57 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.156130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452009da-7c82-45e0-aadd-92fb271bcba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.156130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452009da-7c82-45e0-aadd-92fb271bcba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.157476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-52c20fd2-daaf-4a2c-a707-74af09671d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:29.157678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452009da-7c82-45e0-aadd-92fb271bcba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:38:29.158056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452009da-7c82-45e0-aadd-92fb271bcba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.160054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452009da-7c82-45e0-aadd-92fb271bcba2 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:29.176465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c20fd2-daaf-4a2c-a707-74af09671d57 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.180746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 886/1761] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:38:29.181803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452009da-7c82-45e0-aadd-92fb271bcba2 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.198579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426b9a8-f09a-4695-a560-76b62a9aef66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.202198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b9a8-f09a-4695-a560-76b62a9aef66 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.202485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b9a8-f09a-4695-a560-76b62a9aef66 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.202764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b9a8-f09a-4695-a560-76b62a9aef66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.212482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452009da-7c82-45e0-aadd-92fb271bcba2 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.219984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8e533-9914-4c33-b027-f1ca4cfe224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.220929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8e533-9914-4c33-b027-f1ca4cfe224e admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.221225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8e533-9914-4c33-b027-f1ca4cfe224e admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.228843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8e533-9914-4c33-b027-f1ca4cfe224e admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.229461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8e533-9914-4c33-b027-f1ca4cfe224e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.232091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8e533-9914-4c33-b027-f1ca4cfe224e admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:29.243716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426b9a8-f09a-4695-a560-76b62a9aef66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.249830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426b9a8-f09a-4695-a560-76b62a9aef66 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:29.284651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 876/1762] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:29.284895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426b9a8-f09a-4695-a560-76b62a9aef66 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.298530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426b9a8-f09a-4695-a560-76b62a9aef66 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.314196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fdfc1-52b0-4886-8edc-50f7f55d0a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.315079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fdfc1-52b0-4886-8edc-50f7f55d0a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.320123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fdfc1-52b0-4886-8edc-50f7f55d0a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.320123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fdfc1-52b0-4886-8edc-50f7f55d0a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.320123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fdfc1-52b0-4886-8edc-50f7f55d0a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.320123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fdfc1-52b0-4886-8edc-50f7f55d0a75 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:29.362345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 887/1763] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:29 2022] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:29.366204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8e533-9914-4c33-b027-f1ca4cfe224e admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.474291 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 877/1764] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:29 2022] POST /identity/v3/projects => generated 399 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:29.476631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fdfc1-52b0-4886-8edc-50f7f55d0a75 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.569920 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8e533-9914-4c33-b027-f1ca4cfe224e admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.666627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fdfc1-52b0-4886-8edc-50f7f55d0a75 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.687549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded61fbd-aaac-46f2-b20c-885cdc7553a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.687549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61fbd-aaac-46f2-b20c-885cdc7553a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.687549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61fbd-aaac-46f2-b20c-885cdc7553a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.687549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded61fbd-aaac-46f2-b20c-885cdc7553a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.687869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c889353-c5e4-4917-bcaf-a62a6f24469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.687953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded61fbd-aaac-46f2-b20c-885cdc7553a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.688029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c889353-c5e4-4917-bcaf-a62a6f24469e admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.688029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c889353-c5e4-4917-bcaf-a62a6f24469e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.688029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c889353-c5e4-4917-bcaf-a62a6f24469e admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.688029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c889353-c5e4-4917-bcaf-a62a6f24469e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.688286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded61fbd-aaac-46f2-b20c-885cdc7553a2 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:29.688353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c889353-c5e4-4917-bcaf-a62a6f24469e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:29.821459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 888/1765] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:29 2022] POST /identity/v3/users => generated 282 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:29.823536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 878/1766] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:29 2022] POST /identity/v3/users => generated 300 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:29.827600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded61fbd-aaac-46f2-b20c-885cdc7553a2 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.844729 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c889353-c5e4-4917-bcaf-a62a6f24469e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.868167 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded61fbd-aaac-46f2-b20c-885cdc7553a2 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.875570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c889353-c5e4-4917-bcaf-a62a6f24469e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.882257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bcf05-d224-4bfc-918e-a1cb8a99fcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.883608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bcf05-d224-4bfc-918e-a1cb8a99fcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.883966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bcf05-d224-4bfc-918e-a1cb8a99fcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.884318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bcf05-d224-4bfc-918e-a1cb8a99fcc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.885132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bcf05-d224-4bfc-918e-a1cb8a99fcc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.888154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bcf05-d224-4bfc-918e-a1cb8a99fcc1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:29.890074 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c3bc-a5ba-4518-9423-5fba77764ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.898906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c3bc-a5ba-4518-9423-5fba77764ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.899308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c3bc-a5ba-4518-9423-5fba77764ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.899667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c3bc-a5ba-4518-9423-5fba77764ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.900513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40c3bc-a5ba-4518-9423-5fba77764ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.906404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40c3bc-a5ba-4518-9423-5fba77764ad6 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:29.921510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 879/1767] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:29.925035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bcf05-d224-4bfc-918e-a1cb8a99fcc1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.935285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 889/1768] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:29.939818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c3bc-a5ba-4518-9423-5fba77764ad6 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:29.956330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c3bc-a5ba-4518-9423-5fba77764ad6 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.960642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bcf05-d224-4bfc-918e-a1cb8a99fcc1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:29.979630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4019b4-9957-46ad-b48b-1fdb5668ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.991400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4019b4-9957-46ad-b48b-1fdb5668ca12 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.991400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4019b4-9957-46ad-b48b-1fdb5668ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.991400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4019b4-9957-46ad-b48b-1fdb5668ca12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.991400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4019b4-9957-46ad-b48b-1fdb5668ca12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.991400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4019b4-9957-46ad-b48b-1fdb5668ca12 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:29.992177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2463-0671-4e78-b8a7-09d228f30a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:29.992177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2463-0671-4e78-b8a7-09d228f30a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:29.992177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2463-0671-4e78-b8a7-09d228f30a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:29.992177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc2463-0671-4e78-b8a7-09d228f30a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:29.992465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc2463-0671-4e78-b8a7-09d228f30a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:29.992465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc2463-0671-4e78-b8a7-09d228f30a28 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:30.008345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 880/1769] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:38:30.012412 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2463-0671-4e78-b8a7-09d228f30a28 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:30.023842 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 890/1770] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:30.029648 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc2463-0671-4e78-b8a7-09d228f30a28 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:30.031296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4019b4-9957-46ad-b48b-1fdb5668ca12 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:30.043619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cd972-7bcf-4d0b-86f8-4ea0b722f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:30.046778 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cd972-7bcf-4d0b-86f8-4ea0b722f13c admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:30.047178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cd972-7bcf-4d0b-86f8-4ea0b722f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:30.047555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cd972-7bcf-4d0b-86f8-4ea0b722f13c admin admin] PATH_INFO: `/v3/projects/4b85bd207e1f4423a2fbcb1364362e9e/users/9f32a3ffe1344c21a1c1a9316d39ee9b/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:30.061889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4019b4-9957-46ad-b48b-1fdb5668ca12 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:30.083748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be796c72-4141-41ef-8e03-27780e28f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:30.083978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cd972-7bcf-4d0b-86f8-4ea0b722f13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b85bd207e1f4423a2fbcb1364362e9e, user_id=9f32a3ffe1344c21a1c1a9316d39ee9b, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:30.084668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796c72-4141-41ef-8e03-27780e28f587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:30.085001 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796c72-4141-41ef-8e03-27780e28f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:30.085331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796c72-4141-41ef-8e03-27780e28f587 admin admin] PATH_INFO: `/v3/projects/ac04659de0dd4b00ae51f3fafdfad1f6/users/b321f6f14f5a407fbf15ac98f25672d3/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:30.090734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cd972-7bcf-4d0b-86f8-4ea0b722f13c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:30.119550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be796c72-4141-41ef-8e03-27780e28f587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac04659de0dd4b00ae51f3fafdfad1f6, user_id=b321f6f14f5a407fbf15ac98f25672d3, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:30.125443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be796c72-4141-41ef-8e03-27780e28f587 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:30.170227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 881/1771] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:30 2022] PUT /identity/v3/projects/4b85bd207e1f4423a2fbcb1364362e9e/users/9f32a3ffe1344c21a1c1a9316d39ee9b/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:30.184401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c2268-c717-49df-84ec-f9e4ba03282e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:30.185141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c2268-c717-49df-84ec-f9e4ba03282e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:30.185726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c2268-c717-49df-84ec-f9e4ba03282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:30.246599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-859c2268-c717-49df-84ec-f9e4ba03282e None None] MFA Rules not processed for user `9f32a3ffe1344c21a1c1a9316d39ee9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:30.249234 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-859c2268-c717-49df-84ec-f9e4ba03282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:30.252502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 891/1772] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:30 2022] PUT /identity/v3/projects/ac04659de0dd4b00ae51f3fafdfad1f6/users/b321f6f14f5a407fbf15ac98f25672d3/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:30.265628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbe036-42bd-4c32-924f-fd8682ffe39a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:30.266628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbe036-42bd-4c32-924f-fd8682ffe39a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:30.266628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbe036-42bd-4c32-924f-fd8682ffe39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:30.335283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d8cbe036-42bd-4c32-924f-fd8682ffe39a None None] MFA Rules not processed for user `b321f6f14f5a407fbf15ac98f25672d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:30.338273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d8cbe036-42bd-4c32-924f-fd8682ffe39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:30.353364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 882/1773] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:30.360474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c2268-c717-49df-84ec-f9e4ba03282e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:30.461959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c2268-c717-49df-84ec-f9e4ba03282e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:30.468792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd938e3-fbd8-4024-9d16-53d41e2d5e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:30.469514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd938e3-fbd8-4024-9d16-53d41e2d5e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:30.469953 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd938e3-fbd8-4024-9d16-53d41e2d5e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:30.470242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd938e3-fbd8-4024-9d16-53d41e2d5e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:30.470992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd938e3-fbd8-4024-9d16-53d41e2d5e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:30.473481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd938e3-fbd8-4024-9d16-53d41e2d5e6d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:30.487902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 892/1774] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:30.498241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbe036-42bd-4c32-924f-fd8682ffe39a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:30.515114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbe036-42bd-4c32-924f-fd8682ffe39a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:30.521670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a133e62-4e90-41fc-ac90-5973789aa77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:30.522379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a133e62-4e90-41fc-ac90-5973789aa77b admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:30.522660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a133e62-4e90-41fc-ac90-5973789aa77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:30.523173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a133e62-4e90-41fc-ac90-5973789aa77b admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:30.523875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a133e62-4e90-41fc-ac90-5973789aa77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:30.526114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a133e62-4e90-41fc-ac90-5973789aa77b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:30.570744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 883/1775] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:30 2022] POST /identity/v3/projects => generated 399 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:30.573864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd938e3-fbd8-4024-9d16-53d41e2d5e6d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:30.631751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 893/1776] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:30 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:38:30.635350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a133e62-4e90-41fc-ac90-5973789aa77b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:30.710352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd938e3-fbd8-4024-9d16-53d41e2d5e6d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:30.747795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a133e62-4e90-41fc-ac90-5973789aa77b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:30.777926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd02e00-c749-4a29-a7e6-3ef95f7b498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:30.779869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02e00-c749-4a29-a7e6-3ef95f7b498a admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:30.780269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02e00-c749-4a29-a7e6-3ef95f7b498a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:30.781693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02e00-c749-4a29-a7e6-3ef95f7b498a admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:30.782600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd02e00-c749-4a29-a7e6-3ef95f7b498a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:30.785487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd02e00-c749-4a29-a7e6-3ef95f7b498a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:30.809099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0fcb-5d52-4911-bbfe-e98f0d90dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:30.810144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0fcb-5d52-4911-bbfe-e98f0d90dc97 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:30.811193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0fcb-5d52-4911-bbfe-e98f0d90dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:30.811658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0fcb-5d52-4911-bbfe-e98f0d90dc97 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:30.812524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b0fcb-5d52-4911-bbfe-e98f0d90dc97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:30.815667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b0fcb-5d52-4911-bbfe-e98f0d90dc97 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:31.482610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 894/1777] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:30 2022] POST /identity/v3/users => generated 288 bytes in 847 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:31.486471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd02e00-c749-4a29-a7e6-3ef95f7b498a admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:31.536036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd02e00-c749-4a29-a7e6-3ef95f7b498a admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:31.536036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ca4f0-e382-4ab1-931a-cd85669b2297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:31.536036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ca4f0-e382-4ab1-931a-cd85669b2297 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:31.536036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ca4f0-e382-4ab1-931a-cd85669b2297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:31.536381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ca4f0-e382-4ab1-931a-cd85669b2297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:31.536381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ca4f0-e382-4ab1-931a-cd85669b2297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:31.536381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ca4f0-e382-4ab1-931a-cd85669b2297 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:31.536381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 895/1778] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:38:31.539046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ca4f0-e382-4ab1-931a-cd85669b2297 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:31.553926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ca4f0-e382-4ab1-931a-cd85669b2297 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:31.559280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b3360-4497-439b-876b-d70f059dbf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:31.560269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b3360-4497-439b-876b-d70f059dbf3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:31.560557 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b3360-4497-439b-876b-d70f059dbf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:31.560840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b3360-4497-439b-876b-d70f059dbf3d admin admin] PATH_INFO: `/v3/projects/5b62117aeb60421f8a6369e8455aaa62/users/b911ee89827b4c21abb987f50c3c721a/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:31.578971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b3360-4497-439b-876b-d70f059dbf3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b62117aeb60421f8a6369e8455aaa62, user_id=b911ee89827b4c21abb987f50c3c721a, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:31.581746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b3360-4497-439b-876b-d70f059dbf3d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:31.759795 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 884/1779] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:30 2022] POST /identity/v3/users => generated 306 bytes in 1184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:38:31.763621 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0fcb-5d52-4911-bbfe-e98f0d90dc97 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:31.778961 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0fcb-5d52-4911-bbfe-e98f0d90dc97 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:31.792576 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f453f-3ab8-4772-a135-d1b483478d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:31.793878 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f453f-3ab8-4772-a135-d1b483478d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:31.794329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f453f-3ab8-4772-a135-d1b483478d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:31.794637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f453f-3ab8-4772-a135-d1b483478d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:31.795446 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f453f-3ab8-4772-a135-d1b483478d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:31.797057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f453f-3ab8-4772-a135-d1b483478d23 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:31.815868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 885/1780] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:38:31.826610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f453f-3ab8-4772-a135-d1b483478d23 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:31.850733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f453f-3ab8-4772-a135-d1b483478d23 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:31.874577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 896/1781] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:31 2022] PUT /identity/v3/projects/5b62117aeb60421f8a6369e8455aaa62/users/b911ee89827b4c21abb987f50c3c721a/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:31.877513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b3360-4497-439b-876b-d70f059dbf3d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:31.884306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33553c96-e926-4f77-a346-abc207a92915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:31.885313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33553c96-e926-4f77-a346-abc207a92915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:31.885596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33553c96-e926-4f77-a346-abc207a92915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:31.885936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33553c96-e926-4f77-a346-abc207a92915 admin admin] PATH_INFO: `/v3/projects/3fd6b304a2964c3dbf52f21a94f1e3b0/users/8db2a7b9692942f1bacb3e738c6d463c/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:31.951362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33553c96-e926-4f77-a346-abc207a92915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd6b304a2964c3dbf52f21a94f1e3b0, user_id=8db2a7b9692942f1bacb3e738c6d463c, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:31.959462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33553c96-e926-4f77-a346-abc207a92915 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:32.037797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b3360-4497-439b-876b-d70f059dbf3d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:32.045597 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2102ac-e713-4b6f-be88-2ce639803708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:32.046636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2102ac-e713-4b6f-be88-2ce639803708 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:32.047570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2102ac-e713-4b6f-be88-2ce639803708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:32.050280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2102ac-e713-4b6f-be88-2ce639803708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:32.050280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2102ac-e713-4b6f-be88-2ce639803708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:32.050958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2102ac-e713-4b6f-be88-2ce639803708 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:32.059426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 886/1782] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:31 2022] PUT /identity/v3/projects/3fd6b304a2964c3dbf52f21a94f1e3b0/users/8db2a7b9692942f1bacb3e738c6d463c/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:32.059426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33553c96-e926-4f77-a346-abc207a92915 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:32.075956 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 897/1783] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:32.080190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2102ac-e713-4b6f-be88-2ce639803708 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:32.103251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2102ac-e713-4b6f-be88-2ce639803708 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:32.168927 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33553c96-e926-4f77-a346-abc207a92915 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:32.176270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bdb3a-e3d0-4147-8663-8b5cccc99c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:32.177121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bdb3a-e3d0-4147-8663-8b5cccc99c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:32.177517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bdb3a-e3d0-4147-8663-8b5cccc99c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:32.178332 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bdb3a-e3d0-4147-8663-8b5cccc99c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:32.179570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bdb3a-e3d0-4147-8663-8b5cccc99c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:32.181519 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bdb3a-e3d0-4147-8663-8b5cccc99c3d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:32.215939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 887/1784] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:32.218077 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bdb3a-e3d0-4147-8663-8b5cccc99c3d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:32.229838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bdb3a-e3d0-4147-8663-8b5cccc99c3d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:32.237102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56407844-d052-4150-9b29-49d7d03c06be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:32.238246 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407844-d052-4150-9b29-49d7d03c06be admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:32.238612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407844-d052-4150-9b29-49d7d03c06be admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:32.238954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56407844-d052-4150-9b29-49d7d03c06be admin admin] PATH_INFO: `/v3/projects/3fd6b304a2964c3dbf52f21a94f1e3b0/users/8db2a7b9692942f1bacb3e738c6d463c/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:32.241624 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56407844-d052-4150-9b29-49d7d03c06be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd6b304a2964c3dbf52f21a94f1e3b0, user_id=8db2a7b9692942f1bacb3e738c6d463c, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:32.242200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32802a52-e951-4946-a4d8-df64b435e1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:32.243765 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32802a52-e951-4946-a4d8-df64b435e1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:32.244189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32802a52-e951-4946-a4d8-df64b435e1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:32.244552 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32802a52-e951-4946-a4d8-df64b435e1c8 admin admin] PATH_INFO: `/v3/projects/5b62117aeb60421f8a6369e8455aaa62/users/b911ee89827b4c21abb987f50c3c721a/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:32.245662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56407844-d052-4150-9b29-49d7d03c06be admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:32.248454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32802a52-e951-4946-a4d8-df64b435e1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b62117aeb60421f8a6369e8455aaa62, user_id=b911ee89827b4c21abb987f50c3c721a, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:32.256183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32802a52-e951-4946-a4d8-df64b435e1c8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:32.276808 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 888/1785] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:32 2022] PUT /identity/v3/projects/3fd6b304a2964c3dbf52f21a94f1e3b0/users/8db2a7b9692942f1bacb3e738c6d463c/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:32.278924 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 898/1786] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:32 2022] PUT /identity/v3/projects/5b62117aeb60421f8a6369e8455aaa62/users/b911ee89827b4c21abb987f50c3c721a/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:32.288158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a746-0c1b-4890-820f-cd1fa1dd12a3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:32.288570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a746-0c1b-4890-820f-cd1fa1dd12a3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:32.288951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a746-0c1b-4890-820f-cd1fa1dd12a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:32.289080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a797-a976-403d-ad0a-5bcbc715fca6 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:32.289481 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a797-a976-403d-ad0a-5bcbc715fca6 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:32.289865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a797-a976-403d-ad0a-5bcbc715fca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:32.321848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c078a746-0c1b-4890-820f-cd1fa1dd12a3 None None] MFA Rules not processed for user `8db2a7b9692942f1bacb3e738c6d463c`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:32.323075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c078a746-0c1b-4890-820f-cd1fa1dd12a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:32.343284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-3946a797-a976-403d-ad0a-5bcbc715fca6 None None] MFA Rules not processed for user `b911ee89827b4c21abb987f50c3c721a`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:32.344873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3946a797-a976-403d-ad0a-5bcbc715fca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:32.462461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 889/1787] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:32.487735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 899/1788] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:32 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:32.545480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078a746-0c1b-4890-820f-cd1fa1dd12a3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:32.549802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c078a746-0c1b-4890-820f-cd1fa1dd12a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:32.562294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a797-a976-403d-ad0a-5bcbc715fca6 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:32.563916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3946a797-a976-403d-ad0a-5bcbc715fca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:32.695314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a797-a976-403d-ad0a-5bcbc715fca6 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:32.715857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078a746-0c1b-4890-820f-cd1fa1dd12a3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:32.717473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c487da8-84a6-477b-ab58-880ccec110d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:32.720337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c487da8-84a6-477b-ab58-880ccec110d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:32.720866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c487da8-84a6-477b-ab58-880ccec110d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:32.721344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c487da8-84a6-477b-ab58-880ccec110d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:32.725254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8d4e6-2593-4334-94d1-a0ef8e88492d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:32.729929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8d4e6-2593-4334-94d1-a0ef8e88492d service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:32.729929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8d4e6-2593-4334-94d1-a0ef8e88492d service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:32.732081 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8d4e6-2593-4334-94d1-a0ef8e88492d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:32.754966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c487da8-84a6-477b-ab58-880ccec110d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:32.756685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c487da8-84a6-477b-ab58-880ccec110d3 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:32.759540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8d4e6-2593-4334-94d1-a0ef8e88492d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:32.763751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8d4e6-2593-4334-94d1-a0ef8e88492d service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:32.786528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 900/1789] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:32 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:32.791619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 890/1790] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:33.193798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c487da8-84a6-477b-ab58-880ccec110d3 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:33.217923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c487da8-84a6-477b-ab58-880ccec110d3 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:33.239829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30937c-7176-4b95-8aa2-ec7508e7053f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:33.242506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30937c-7176-4b95-8aa2-ec7508e7053f service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:33.242506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30937c-7176-4b95-8aa2-ec7508e7053f service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:33.242506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30937c-7176-4b95-8aa2-ec7508e7053f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:33.361089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30937c-7176-4b95-8aa2-ec7508e7053f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:33.362603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30937c-7176-4b95-8aa2-ec7508e7053f service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:33.373093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 901/1791] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:34.924616 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8d4e6-2593-4334-94d1-a0ef8e88492d service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:35.039513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8d4e6-2593-4334-94d1-a0ef8e88492d service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:35.063686 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:35.064455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:35.064694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:35.065096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] PATH_INFO: `/v3/users/b321f6f14f5a407fbf15ac98f25672d3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:35.072394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b321f6f14f5a407fbf15ac98f25672d3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:35.075390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:35.129304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7799dd-c30c-4fde-8941-b03fed5f48c1 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:35.129839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7799dd-c30c-4fde-8941-b03fed5f48c1 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:35.129839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7799dd-c30c-4fde-8941-b03fed5f48c1 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:35.131229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 902/1792] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 12 20:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:38:35.142682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271ba85-f750-4292-9007-0372b9681ae7 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:35.142682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271ba85-f750-4292-9007-0372b9681ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:35.142682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271ba85-f750-4292-9007-0372b9681ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:35.160157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5271ba85-f750-4292-9007-0372b9681ae7 None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:35.161398 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5271ba85-f750-4292-9007-0372b9681ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:35.252166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 903/1793] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 12 20:38:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:35.304426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271ba85-f750-4292-9007-0372b9681ae7 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:35.330474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271ba85-f750-4292-9007-0372b9681ae7 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:35.336514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b321f6f14f5a407fbf15ac98f25672d3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:35.350527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c01925-8a06-4e01-a63d-55c223e72fb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:35.367285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01925-8a06-4e01-a63d-55c223e72fb5 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:35.367285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01925-8a06-4e01-a63d-55c223e72fb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:35.367285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c01925-8a06-4e01-a63d-55c223e72fb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:35.373344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b321f6f14f5a407fbf15ac98f25672d3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:35.374195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b321f6f14f5a407fbf15ac98f25672d3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:35.389751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c01925-8a06-4e01-a63d-55c223e72fb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:35.393041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c01925-8a06-4e01-a63d-55c223e72fb5 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:35.406176 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 904/1794] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:38:35.540320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b321f6f14f5a407fbf15ac98f25672d3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:35.553100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b321f6f14f5a407fbf15ac98f25672d3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:35.563829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 891/1795] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:34 2022] DELETE /identity/v3/users/b321f6f14f5a407fbf15ac98f25672d3 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:35.565356 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da235-18a8-4a4b-bb37-203234e6e0f2 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:35.565815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da235-18a8-4a4b-bb37-203234e6e0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:35.566270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da235-18a8-4a4b-bb37-203234e6e0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:35.614962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-745da235-18a8-4a4b-bb37-203234e6e0f2 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:35.616286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-745da235-18a8-4a4b-bb37-203234e6e0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:35.702597 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 905/1796] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:35.718834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:35.720292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:35.818530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b92b6-0fe3-4d30-9162-21e434bad31c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:35.825141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0a9e4-85d0-440b-9a49-40da15d49186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:35.828446 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0a9e4-85d0-440b-9a49-40da15d49186 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:35.835044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0a9e4-85d0-440b-9a49-40da15d49186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:35.835044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0a9e4-85d0-440b-9a49-40da15d49186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:35.858066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0a9e4-85d0-440b-9a49-40da15d49186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:35.859771 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0a9e4-85d0-440b-9a49-40da15d49186 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:35.872352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 892/1797] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:36.553928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745da235-18a8-4a4b-bb37-203234e6e0f2 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:36.553928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-745da235-18a8-4a4b-bb37-203234e6e0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:36.561684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745da235-18a8-4a4b-bb37-203234e6e0f2 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:36.566349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:36.567222 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:36.567515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:36.567798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] PATH_INFO: `/v3/projects/ac04659de0dd4b00ae51f3fafdfad1f6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:36.569001 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac04659de0dd4b00ae51f3fafdfad1f6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:36.570959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:36.811052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0a9e4-85d0-440b-9a49-40da15d49186 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:36.812459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6cd0a9e4-85d0-440b-9a49-40da15d49186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:36.827416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0a9e4-85d0-440b-9a49-40da15d49186 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:36.835048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:36.836326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:36.836886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:36.837240 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] PATH_INFO: `/v3/users/35ec1ba18f4a42318d2ac77920d01d88` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:36.839326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ec1ba18f4a42318d2ac77920d01d88)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:36.842090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:36.876937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac04659de0dd4b00ae51f3fafdfad1f6', 'request_id': 'req-7b328282-68e7-45b5-8f0a-048b1e3a7129'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:36.884605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac04659de0dd4b00ae51f3fafdfad1f6', 'request_id': 'req-7b328282-68e7-45b5-8f0a-048b1e3a7129'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:36.940156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac04659de0dd4b00ae51f3fafdfad1f6', 'request_id': 'req-7b328282-68e7-45b5-8f0a-048b1e3a7129'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:36.958921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] The token cache is being invalidate because project ac04659de0dd4b00ae51f3fafdfad1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:36.958921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:36.959768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:36.961708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 906/1798] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:36 2022] DELETE /identity/v3/projects/ac04659de0dd4b00ae51f3fafdfad1f6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:36.965710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:36.967791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:37.006632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ec1ba18f4a42318d2ac77920d01d88'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:37.024408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ec1ba18f4a42318d2ac77920d01d88'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:37.025236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ec1ba18f4a42318d2ac77920d01d88'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:37.042284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b328282-68e7-45b5-8f0a-048b1e3a7129 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:37.047241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:37.048132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:37.048416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:37.048705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] PATH_INFO: `/v3/users/b911ee89827b4c21abb987f50c3c721a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:37.050054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b911ee89827b4c21abb987f50c3c721a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:37.052524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:37.082586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ec1ba18f4a42318d2ac77920d01d88'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:37.090042 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ae24f244-0287-4fa5-9957-6638222b08f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ec1ba18f4a42318d2ac77920d01d88'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:37.096206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 893/1799] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:36 2022] DELETE /identity/v3/users/35ec1ba18f4a42318d2ac77920d01d88 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:38:37.100510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25671b5-760b-4745-97ee-7692cb773d10 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:37.100885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25671b5-760b-4745-97ee-7692cb773d10 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:37.101179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25671b5-760b-4745-97ee-7692cb773d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:37.120365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d25671b5-760b-4745-97ee-7692cb773d10 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:37.122411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d25671b5-760b-4745-97ee-7692cb773d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:37.194035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 894/1800] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:37.216271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25671b5-760b-4745-97ee-7692cb773d10 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:37.222170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d25671b5-760b-4745-97ee-7692cb773d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:37.262426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b911ee89827b4c21abb987f50c3c721a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:37.263386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b911ee89827b4c21abb987f50c3c721a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:37.264232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b911ee89827b4c21abb987f50c3c721a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:37.277559 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b911ee89827b4c21abb987f50c3c721a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:37.285147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b911ee89827b4c21abb987f50c3c721a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:37.294632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25671b5-760b-4745-97ee-7692cb773d10 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:37.298517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f39ee8-22af-4d25-99e4-2b1b232f566d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:37.299254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39ee8-22af-4d25-99e4-2b1b232f566d service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:37.299620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39ee8-22af-4d25-99e4-2b1b232f566d service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:37.299975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39ee8-22af-4d25-99e4-2b1b232f566d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:37.301882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-05f39ee8-22af-4d25-99e4-2b1b232f566d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:37.315615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f39ee8-22af-4d25-99e4-2b1b232f566d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:37.316447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f39ee8-22af-4d25-99e4-2b1b232f566d service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:37.335860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 895/1801] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:37.372694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 907/1802] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:36 2022] DELETE /identity/v3/users/b911ee89827b4c21abb987f50c3c721a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:38:37.923428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f39ee8-22af-4d25-99e4-2b1b232f566d service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:37.925371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-05f39ee8-22af-4d25-99e4-2b1b232f566d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:37.935945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:37.938141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:37.954513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f39ee8-22af-4d25-99e4-2b1b232f566d service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:38.052084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:38.054140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.058025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.058025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] PATH_INFO: `/v3/projects/5b62117aeb60421f8a6369e8455aaa62` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.058025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b62117aeb60421f8a6369e8455aaa62)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:38.060978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:38.072686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aa372-3f5a-4ecd-bd7d-dafbbd7d2f6f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:38.078801 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:38.081495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.081792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.082073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] PATH_INFO: `/v3/projects/6c2ccc998d5f486889e3bdf5e09f8177` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.091753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2ccc998d5f486889e3bdf5e09f8177)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:38.094033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:38.177939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b62117aeb60421f8a6369e8455aaa62', 'request_id': 'req-8227f70c-f54b-45b3-891f-593d1a972afd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.183406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b62117aeb60421f8a6369e8455aaa62', 'request_id': 'req-8227f70c-f54b-45b3-891f-593d1a972afd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.260063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2ccc998d5f486889e3bdf5e09f8177', 'request_id': 'req-321b3967-ee8d-4265-aa43-1a7402e8ffc2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.265110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b62117aeb60421f8a6369e8455aaa62', 'request_id': 'req-8227f70c-f54b-45b3-891f-593d1a972afd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.266287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2ccc998d5f486889e3bdf5e09f8177', 'request_id': 'req-321b3967-ee8d-4265-aa43-1a7402e8ffc2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.278324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] The token cache is being invalidate because project 5b62117aeb60421f8a6369e8455aaa62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:38.278618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.279274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8227f70c-f54b-45b3-891f-593d1a972afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.281128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 896/1803] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:37 2022] DELETE /identity/v3/projects/5b62117aeb60421f8a6369e8455aaa62 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:38.285606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e187181-2a4e-4a17-8d0b-2966a2ae0643 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.285895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e187181-2a4e-4a17-8d0b-2966a2ae0643 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.286195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e187181-2a4e-4a17-8d0b-2966a2ae0643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.304358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9e187181-2a4e-4a17-8d0b-2966a2ae0643 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:38.305600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9e187181-2a4e-4a17-8d0b-2966a2ae0643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:38.334024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2ccc998d5f486889e3bdf5e09f8177', 'request_id': 'req-321b3967-ee8d-4265-aa43-1a7402e8ffc2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.348245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] The token cache is being invalidate because project 6c2ccc998d5f486889e3bdf5e09f8177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:38.348992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.350058 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.351977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 908/1804] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:37 2022] DELETE /identity/v3/projects/6c2ccc998d5f486889e3bdf5e09f8177 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:38.355755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:38.366329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:38.369478 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 897/1805] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:38.377493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f97c-9fa2-4874-98ee-9ff5eb42d972 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.378067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f97c-9fa2-4874-98ee-9ff5eb42d972 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.381592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6f97c-9fa2-4874-98ee-9ff5eb42d972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.389210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b3967-ee8d-4265-aa43-1a7402e8ffc2 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:38.395190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:38.396337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.396509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.396790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] PATH_INFO: `/v3/users/783470026750457c88b6916f8d313bbc` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.398314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=783470026750457c88b6916f8d313bbc)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:38.400322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:38.401419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6de6f97c-9fa2-4874-98ee-9ff5eb42d972 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:38.403629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6de6f97c-9fa2-4874-98ee-9ff5eb42d972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:38.419642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 898/1806] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:38.423633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6f97c-9fa2-4874-98ee-9ff5eb42d972 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:38.434332 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6f97c-9fa2-4874-98ee-9ff5eb42d972 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:38.439436 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2444ba8-a05e-4752-aba6-3d32bcbf9a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:38.440122 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444ba8-a05e-4752-aba6-3d32bcbf9a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.440412 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444ba8-a05e-4752-aba6-3d32bcbf9a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.440701 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444ba8-a05e-4752-aba6-3d32bcbf9a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.441480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2444ba8-a05e-4752-aba6-3d32bcbf9a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:38:38.441822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2444ba8-a05e-4752-aba6-3d32bcbf9a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:38.443430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2444ba8-a05e-4752-aba6-3d32bcbf9a6e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:38.456061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 899/1807] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:38:38.460547 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2444ba8-a05e-4752-aba6-3d32bcbf9a6e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:38.471506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2444ba8-a05e-4752-aba6-3d32bcbf9a6e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:38.476186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33c010-69d2-4525-9830-5fb0b96db43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:38.476853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c010-69d2-4525-9830-5fb0b96db43e admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.477146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c010-69d2-4525-9830-5fb0b96db43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.477461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c010-69d2-4525-9830-5fb0b96db43e admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.478165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33c010-69d2-4525-9830-5fb0b96db43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:38.480162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33c010-69d2-4525-9830-5fb0b96db43e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:38.586910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 900/1808] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:38 2022] POST /identity/v3/projects => generated 355 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:38:38.591401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33c010-69d2-4525-9830-5fb0b96db43e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:38.650849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33c010-69d2-4525-9830-5fb0b96db43e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:38.655963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103345b6-e249-47c6-b632-78b623b6912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:38.656642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103345b6-e249-47c6-b632-78b623b6912a admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.656934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103345b6-e249-47c6-b632-78b623b6912a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.657215 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103345b6-e249-47c6-b632-78b623b6912a admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.658005 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103345b6-e249-47c6-b632-78b623b6912a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:38.659901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103345b6-e249-47c6-b632-78b623b6912a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:38.679534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783470026750457c88b6916f8d313bbc'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.680303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783470026750457c88b6916f8d313bbc'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.681183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783470026750457c88b6916f8d313bbc'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.693837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783470026750457c88b6916f8d313bbc'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.701121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783470026750457c88b6916f8d313bbc'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:38.792259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 901/1809] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:38 2022] POST /identity/v3/users => generated 278 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:38:38.799477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103345b6-e249-47c6-b632-78b623b6912a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:38.801089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-103345b6-e249-47c6-b632-78b623b6912a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:38.813493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103345b6-e249-47c6-b632-78b623b6912a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:38.819176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf774d2-7603-4698-b1ed-7a4b9c5c7d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:38.821117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf774d2-7603-4698-b1ed-7a4b9c5c7d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.821934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf774d2-7603-4698-b1ed-7a4b9c5c7d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.821934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf774d2-7603-4698-b1ed-7a4b9c5c7d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.829341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf774d2-7603-4698-b1ed-7a4b9c5c7d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:38.829909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 909/1810] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:38 2022] DELETE /identity/v3/users/783470026750457c88b6916f8d313bbc => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:38.830002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf774d2-7603-4698-b1ed-7a4b9c5c7d44 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:38.837762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 902/1811] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:38:38.842009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:38.914204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb7bf9-df68-4697-b3d2-45ed016b55dc admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:38.920972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338dad9-0625-4940-8c1a-0a84b1aadbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:38.922243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338dad9-0625-4940-8c1a-0a84b1aadbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.922524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338dad9-0625-4940-8c1a-0a84b1aadbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.923317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338dad9-0625-4940-8c1a-0a84b1aadbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.924302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338dad9-0625-4940-8c1a-0a84b1aadbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:38.926410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338dad9-0625-4940-8c1a-0a84b1aadbe7 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:38.941393 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 910/1812] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:38.945188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf774d2-7603-4698-b1ed-7a4b9c5c7d44 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:38.959375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf774d2-7603-4698-b1ed-7a4b9c5c7d44 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:38.964902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b24ab-5af4-4d13-90ea-6192c4667894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:38.967150 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b24ab-5af4-4d13-90ea-6192c4667894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:38.967150 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b24ab-5af4-4d13-90ea-6192c4667894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:38.967150 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b24ab-5af4-4d13-90ea-6192c4667894 admin admin] PATH_INFO: `/v3/projects/da06f4c1da4e4a8088dd3c348a304340/users/5f83f80f0bcf4856b657ffc37d3881a3/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:38.983291 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b24ab-5af4-4d13-90ea-6192c4667894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da06f4c1da4e4a8088dd3c348a304340, user_id=5f83f80f0bcf4856b657ffc37d3881a3, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:38.986180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b24ab-5af4-4d13-90ea-6192c4667894 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:39.080734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 903/1813] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:38 2022] PUT /identity/v3/projects/da06f4c1da4e4a8088dd3c348a304340/users/5f83f80f0bcf4856b657ffc37d3881a3/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:39.093020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc2d8-0b38-4260-95b8-01b226f293ac None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:39.093330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc2d8-0b38-4260-95b8-01b226f293ac None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:39.093775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc2d8-0b38-4260-95b8-01b226f293ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:39.132835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-517bc2d8-0b38-4260-95b8-01b226f293ac None None] MFA Rules not processed for user `5f83f80f0bcf4856b657ffc37d3881a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:39.134702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-517bc2d8-0b38-4260-95b8-01b226f293ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:39.249109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 911/1814] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:39 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:39.254670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b24ab-5af4-4d13-90ea-6192c4667894 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:39.429447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b24ab-5af4-4d13-90ea-6192c4667894 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:39.438559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b125-efc2-4c4c-8b0e-33d4e1dec3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:39.439760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b125-efc2-4c4c-8b0e-33d4e1dec3af admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:39.440100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b125-efc2-4c4c-8b0e-33d4e1dec3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:39.440450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b125-efc2-4c4c-8b0e-33d4e1dec3af admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:39.441580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b125-efc2-4c4c-8b0e-33d4e1dec3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:39.443546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b125-efc2-4c4c-8b0e-33d4e1dec3af admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:39.485652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bc2d8-0b38-4260-95b8-01b226f293ac None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:39.487140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-517bc2d8-0b38-4260-95b8-01b226f293ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:39.512071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bc2d8-0b38-4260-95b8-01b226f293ac None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:39.521411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:39.523204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:39.523731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:39.524209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] PATH_INFO: `/v3/projects/541f194012c84e23ab694af7073297b9` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:39.526508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=541f194012c84e23ab694af7073297b9)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:39.530413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:39.552869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 904/1815] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:39 2022] POST /identity/v3/projects => generated 355 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:39.557188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b125-efc2-4c4c-8b0e-33d4e1dec3af admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:39.669154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b125-efc2-4c4c-8b0e-33d4e1dec3af admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:39.674376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd4207-1071-43e3-be8b-d921ac747231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:39.675132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd4207-1071-43e3-be8b-d921ac747231 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:39.675788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd4207-1071-43e3-be8b-d921ac747231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:39.675788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd4207-1071-43e3-be8b-d921ac747231 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:39.676341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd4207-1071-43e3-be8b-d921ac747231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:39.678293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd4207-1071-43e3-be8b-d921ac747231 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:39.768947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541f194012c84e23ab694af7073297b9', 'request_id': 'req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:39.774866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541f194012c84e23ab694af7073297b9', 'request_id': 'req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:39.808886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 905/1816] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:39 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:39.812579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd4207-1071-43e3-be8b-d921ac747231 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:39.814315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-eacd4207-1071-43e3-be8b-d921ac747231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:39.826782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd4207-1071-43e3-be8b-d921ac747231 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:39.878151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541f194012c84e23ab694af7073297b9', 'request_id': 'req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:39.896919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] The token cache is being invalidate because project 541f194012c84e23ab694af7073297b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:39.897298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:39.898136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:39.899874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 912/1817] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:39 2022] DELETE /identity/v3/projects/541f194012c84e23ab694af7073297b9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:39.900743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:39.901393 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:39.901717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:39.902800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:39.903449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] PATH_INFO: `/v3/users/9f32a3ffe1344c21a1c1a9316d39ee9b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:39.904151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:39.907930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f32a3ffe1344c21a1c1a9316d39ee9b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:39.907930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:39.926304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272b941-fdae-42de-a6c5-1cf67cdc7dc6 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:39.940249 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde937af-cdad-41e8-8d02-02a0256ec7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:39.940923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde937af-cdad-41e8-8d02-02a0256ec7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:39.941210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde937af-cdad-41e8-8d02-02a0256ec7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:39.941777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde937af-cdad-41e8-8d02-02a0256ec7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:39.942519 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde937af-cdad-41e8-8d02-02a0256ec7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:39.944126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde937af-cdad-41e8-8d02-02a0256ec7f7 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:39.958771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 913/1818] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:39.960352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581155-1cac-40f7-937a-8486019d5518 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:39.960748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581155-1cac-40f7-937a-8486019d5518 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:39.961219 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581155-1cac-40f7-937a-8486019d5518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:39.993439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-6c581155-1cac-40f7-937a-8486019d5518 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:39.999651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6c581155-1cac-40f7-937a-8486019d5518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:40.004301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 914/1819] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:40.005126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c581155-1cac-40f7-937a-8486019d5518 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.022543 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c581155-1cac-40f7-937a-8486019d5518 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.027960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ef3cc-8ece-4dbc-9a37-67f2cdd386e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.028863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ef3cc-8ece-4dbc-9a37-67f2cdd386e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.029150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ef3cc-8ece-4dbc-9a37-67f2cdd386e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.029456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ef3cc-8ece-4dbc-9a37-67f2cdd386e6 admin admin] PATH_INFO: `/v3/projects/e0b47e1673b84e26accec1075c47140e/users/3b69f1943b9c47778fb790e386dda57c/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.044223 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ef3cc-8ece-4dbc-9a37-67f2cdd386e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b47e1673b84e26accec1075c47140e, user_id=3b69f1943b9c47778fb790e386dda57c, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.046974 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ef3cc-8ece-4dbc-9a37-67f2cdd386e6 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:40.121636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f32a3ffe1344c21a1c1a9316d39ee9b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:40.133963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f32a3ffe1344c21a1c1a9316d39ee9b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:40.134679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f32a3ffe1344c21a1c1a9316d39ee9b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:40.162228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 915/1820] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:40 2022] PUT /identity/v3/projects/e0b47e1673b84e26accec1075c47140e/users/3b69f1943b9c47778fb790e386dda57c/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:40.163745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374208a5-aee5-46a7-b765-c541aac9637f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.163840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374208a5-aee5-46a7-b765-c541aac9637f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.164063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374208a5-aee5-46a7-b765-c541aac9637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.182350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-374208a5-aee5-46a7-b765-c541aac9637f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:40.184119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-374208a5-aee5-46a7-b765-c541aac9637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:40.231487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f32a3ffe1344c21a1c1a9316d39ee9b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:40.239014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f32a3ffe1344c21a1c1a9316d39ee9b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:40.241787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 916/1821] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:40.242653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374208a5-aee5-46a7-b765-c541aac9637f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.253305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 906/1822] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:39 2022] DELETE /identity/v3/users/9f32a3ffe1344c21a1c1a9316d39ee9b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:40.254398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.255057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374208a5-aee5-46a7-b765-c541aac9637f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.255728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:40.314079 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a781a7-1eff-4f98-9f32-66f23a4ef028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.314687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a781a7-1eff-4f98-9f32-66f23a4ef028 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.314980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a781a7-1eff-4f98-9f32-66f23a4ef028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.315263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a781a7-1eff-4f98-9f32-66f23a4ef028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.316011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a781a7-1eff-4f98-9f32-66f23a4ef028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.317657 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a781a7-1eff-4f98-9f32-66f23a4ef028 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:40.323498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd2750-5f1c-466a-9ed5-f8981e52d534 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.329002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 917/1823] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:40.329312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7ec14-8829-41a8-896d-0377a84f1d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.330365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7ec14-8829-41a8-896d-0377a84f1d20 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.330453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e1586-b78a-40f6-af8f-4a4433ac2389 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.330544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7ec14-8829-41a8-896d-0377a84f1d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.330652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e1586-b78a-40f6-af8f-4a4433ac2389 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.330732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7ec14-8829-41a8-896d-0377a84f1d20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.330928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e1586-b78a-40f6-af8f-4a4433ac2389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.331431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7ec14-8829-41a8-896d-0377a84f1d20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:38:40.331747 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7ec14-8829-41a8-896d-0377a84f1d20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.333721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7ec14-8829-41a8-896d-0377a84f1d20 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:40.349706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 907/1824] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:38:40.349706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7ec14-8829-41a8-896d-0377a84f1d20 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.349944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-722e1586-b78a-40f6-af8f-4a4433ac2389 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:40.350598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-722e1586-b78a-40f6-af8f-4a4433ac2389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:40.351346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e0c7ec14-8829-41a8-896d-0377a84f1d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:40.361400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 918/1825] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:40.362231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e1586-b78a-40f6-af8f-4a4433ac2389 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.371423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7ec14-8829-41a8-896d-0377a84f1d20 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.372779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e1586-b78a-40f6-af8f-4a4433ac2389 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.377038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f45dd-7854-4988-b0e3-02562fd01eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.378692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f45dd-7854-4988-b0e3-02562fd01eee admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.379031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3de37-1107-4b31-af33-03c4d7d913a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.379193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f45dd-7854-4988-b0e3-02562fd01eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.379388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f45dd-7854-4988-b0e3-02562fd01eee admin admin] PATH_INFO: `/v3/projects/e0b47e1673b84e26accec1075c47140e/users/3b69f1943b9c47778fb790e386dda57c/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.379748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3de37-1107-4b31-af33-03c4d7d913a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.380033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3de37-1107-4b31-af33-03c4d7d913a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.380342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3de37-1107-4b31-af33-03c4d7d913a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.381064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3de37-1107-4b31-af33-03c4d7d913a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.381664 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f45dd-7854-4988-b0e3-02562fd01eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b47e1673b84e26accec1075c47140e, user_id=3b69f1943b9c47778fb790e386dda57c, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.383062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3de37-1107-4b31-af33-03c4d7d913a1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:40.385328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f45dd-7854-4988-b0e3-02562fd01eee admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:40.396440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 908/1826] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:40 2022] PUT /identity/v3/projects/e0b47e1673b84e26accec1075c47140e/users/3b69f1943b9c47778fb790e386dda57c/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:40.398169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f45dd-7854-4988-b0e3-02562fd01eee admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.399999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cf2f45dd-7854-4988-b0e3-02562fd01eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:40.459420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f45dd-7854-4988-b0e3-02562fd01eee admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.463608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99867c-204d-4c8a-a2c5-2cd710c828f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.464017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99867c-204d-4c8a-a2c5-2cd710c828f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.464350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99867c-204d-4c8a-a2c5-2cd710c828f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.465322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99867c-204d-4c8a-a2c5-2cd710c828f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.485070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 919/1827] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:40 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:40.486977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ddcf8-4979-4809-b481-23f6fef1108e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.486977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ddcf8-4979-4809-b481-23f6fef1108e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.486977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ddcf8-4979-4809-b481-23f6fef1108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.519861 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5d9ddcf8-4979-4809-b481-23f6fef1108e None None] MFA Rules not processed for user `3b69f1943b9c47778fb790e386dda57c`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:40.521474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5d9ddcf8-4979-4809-b481-23f6fef1108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:40.539536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99867c-204d-4c8a-a2c5-2cd710c828f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.541190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99867c-204d-4c8a-a2c5-2cd710c828f7 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:40.562817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 909/1828] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:40.566708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99867c-204d-4c8a-a2c5-2cd710c828f7 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.573148 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99867c-204d-4c8a-a2c5-2cd710c828f7 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.613524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 920/1829] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:40 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:40.626198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ddcf8-4979-4809-b481-23f6fef1108e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.628639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5d9ddcf8-4979-4809-b481-23f6fef1108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:40.638150 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a89ff-b0a8-4e09-baad-307a81750b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.638841 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a89ff-b0a8-4e09-baad-307a81750b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.639126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a89ff-b0a8-4e09-baad-307a81750b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.639496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a89ff-b0a8-4e09-baad-307a81750b42 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.640353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a89ff-b0a8-4e09-baad-307a81750b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.643359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a89ff-b0a8-4e09-baad-307a81750b42 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:40.719811 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ddcf8-4979-4809-b481-23f6fef1108e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.725969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45da7-ef56-40d6-b4cf-b8c6ad2e2577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.725969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45da7-ef56-40d6-b4cf-b8c6ad2e2577 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.725969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45da7-ef56-40d6-b4cf-b8c6ad2e2577 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.725969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45da7-ef56-40d6-b4cf-b8c6ad2e2577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.742747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45da7-ef56-40d6-b4cf-b8c6ad2e2577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.744827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45da7-ef56-40d6-b4cf-b8c6ad2e2577 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:40.756844 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 921/1830] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:40 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:40.780396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 910/1831] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:40 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:40.787397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45da7-ef56-40d6-b4cf-b8c6ad2e2577 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.808302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45da7-ef56-40d6-b4cf-b8c6ad2e2577 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.813670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191e308-ad2a-4c11-8d77-7af19e0cb8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.814768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191e308-ad2a-4c11-8d77-7af19e0cb8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.815154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191e308-ad2a-4c11-8d77-7af19e0cb8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.815777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191e308-ad2a-4c11-8d77-7af19e0cb8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.816616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191e308-ad2a-4c11-8d77-7af19e0cb8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.818681 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191e308-ad2a-4c11-8d77-7af19e0cb8e6 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:40.836768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 922/1832] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:40.838336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a89ff-b0a8-4e09-baad-307a81750b42 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.851981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a89ff-b0a8-4e09-baad-307a81750b42 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.889160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5110673-4821-4161-9cb9-12b6aee97627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.889879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5110673-4821-4161-9cb9-12b6aee97627 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.890167 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5110673-4821-4161-9cb9-12b6aee97627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.890451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5110673-4821-4161-9cb9-12b6aee97627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.891412 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5110673-4821-4161-9cb9-12b6aee97627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.893841 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5110673-4821-4161-9cb9-12b6aee97627 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:40.906413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 911/1833] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:40.910770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191e308-ad2a-4c11-8d77-7af19e0cb8e6 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:40.933157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191e308-ad2a-4c11-8d77-7af19e0cb8e6 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:40.938466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d4d1f-82b8-4143-98a1-c7e1ca8c1ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:40.939405 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d4d1f-82b8-4143-98a1-c7e1ca8c1ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:40.939692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d4d1f-82b8-4143-98a1-c7e1ca8c1ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:40.939968 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d4d1f-82b8-4143-98a1-c7e1ca8c1ab8 admin admin] PATH_INFO: `/v3/projects/bb824bf2b6dd48ca9b9e9fa7767dd67d/users/243514f3745f4102a29bb2fb7820f4e8/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:40.958914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d4d1f-82b8-4143-98a1-c7e1ca8c1ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb824bf2b6dd48ca9b9e9fa7767dd67d, user_id=243514f3745f4102a29bb2fb7820f4e8, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:40.963182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d4d1f-82b8-4143-98a1-c7e1ca8c1ab8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:41.049943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 923/1834] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:40 2022] PUT /identity/v3/projects/bb824bf2b6dd48ca9b9e9fa7767dd67d/users/243514f3745f4102a29bb2fb7820f4e8/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:41.059882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b08f4-8f07-412e-8e4c-43b5947f568e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:41.060285 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b08f4-8f07-412e-8e4c-43b5947f568e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:41.060491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b08f4-8f07-412e-8e4c-43b5947f568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:41.079633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d4d1f-82b8-4143-98a1-c7e1ca8c1ab8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:41.097233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5d7b08f4-8f07-412e-8e4c-43b5947f568e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:41.098761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5d7b08f4-8f07-412e-8e4c-43b5947f568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:41.183659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d4d1f-82b8-4143-98a1-c7e1ca8c1ab8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:41.196533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a5191-8e20-4732-a5a4-2b453e6ba728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:41.197612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5191-8e20-4732-a5a4-2b453e6ba728 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:41.197910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5191-8e20-4732-a5a4-2b453e6ba728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:41.198193 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5191-8e20-4732-a5a4-2b453e6ba728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:41.203119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-fb6a5191-8e20-4732-a5a4-2b453e6ba728 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:41.279945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 912/1835] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:41.283402 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b08f4-8f07-412e-8e4c-43b5947f568e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:41.287580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5d7b08f4-8f07-412e-8e4c-43b5947f568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:41.295330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a5191-8e20-4732-a5a4-2b453e6ba728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:41.296811 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a5191-8e20-4732-a5a4-2b453e6ba728 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:41.308662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 924/1836] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:41 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:38:41.310017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a5191-8e20-4732-a5a4-2b453e6ba728 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:41.322093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b08f4-8f07-412e-8e4c-43b5947f568e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:41.344144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:41.344759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:41.344837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:41.345095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] PATH_INFO: `/v3/projects/4b85bd207e1f4423a2fbcb1364362e9e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:41.348814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b85bd207e1f4423a2fbcb1364362e9e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:41.351176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:41.392638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a5191-8e20-4732-a5a4-2b453e6ba728 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:41.396345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211b09e-3821-44ed-8577-89df747b5665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:41.397036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211b09e-3821-44ed-8577-89df747b5665 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:41.397339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211b09e-3821-44ed-8577-89df747b5665 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:41.397630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211b09e-3821-44ed-8577-89df747b5665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:41.414027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211b09e-3821-44ed-8577-89df747b5665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:41.415854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211b09e-3821-44ed-8577-89df747b5665 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:41.429622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 925/1837] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:41.500691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b85bd207e1f4423a2fbcb1364362e9e', 'request_id': 'req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:41.519014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b85bd207e1f4423a2fbcb1364362e9e', 'request_id': 'req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:41.608154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b85bd207e1f4423a2fbcb1364362e9e', 'request_id': 'req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:41.622924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] The token cache is being invalidate because project 4b85bd207e1f4423a2fbcb1364362e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:41.624338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:41.624488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:41.629797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 913/1838] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:41 2022] DELETE /identity/v3/projects/4b85bd207e1f4423a2fbcb1364362e9e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:41.631230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211b09e-3821-44ed-8577-89df747b5665 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:41.644497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211b09e-3821-44ed-8577-89df747b5665 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:41.755946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:41.756828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:41.757166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:41.757702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] PATH_INFO: `/v3/users/8db2a7b9692942f1bacb3e738c6d463c` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:41.758929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db2a7b9692942f1bacb3e738c6d463c)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:41.761009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:41.952881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db2a7b9692942f1bacb3e738c6d463c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:41.953942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db2a7b9692942f1bacb3e738c6d463c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:41.954759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db2a7b9692942f1bacb3e738c6d463c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:41.985924 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db2a7b9692942f1bacb3e738c6d463c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:41.996718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-3c64993e-01c9-4e84-82b8-6e9fb4ea625f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db2a7b9692942f1bacb3e738c6d463c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:42.100088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 926/1839] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:41 2022] DELETE /identity/v3/users/8db2a7b9692942f1bacb3e738c6d463c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:42.562237 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:42.565688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:42.588822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01be82-2a0e-4d01-b466-6a81cd3ec45b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:42.694016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:42.694933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:42.695217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:42.695493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] PATH_INFO: `/v3/projects/3fd6b304a2964c3dbf52f21a94f1e3b0` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:42.696758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd6b304a2964c3dbf52f21a94f1e3b0)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:42.700259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:42.828338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd6b304a2964c3dbf52f21a94f1e3b0', 'request_id': 'req-32fba25e-1822-4f00-bd0f-8c05304c74b3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:42.834454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd6b304a2964c3dbf52f21a94f1e3b0', 'request_id': 'req-32fba25e-1822-4f00-bd0f-8c05304c74b3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:42.910855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd6b304a2964c3dbf52f21a94f1e3b0', 'request_id': 'req-32fba25e-1822-4f00-bd0f-8c05304c74b3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:42.930703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] The token cache is being invalidate because project 3fd6b304a2964c3dbf52f21a94f1e3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:42.931010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:42.931726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-32fba25e-1822-4f00-bd0f-8c05304c74b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:42.933693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 914/1840] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:42 2022] DELETE /identity/v3/projects/3fd6b304a2964c3dbf52f21a94f1e3b0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:38:42.938680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844627e2-771d-4b68-b4ec-3fda2e6eb498 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:42.939212 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844627e2-771d-4b68-b4ec-3fda2e6eb498 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:42.939492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844627e2-771d-4b68-b4ec-3fda2e6eb498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:42.957609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-844627e2-771d-4b68-b4ec-3fda2e6eb498 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:42.958805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-844627e2-771d-4b68-b4ec-3fda2e6eb498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:43.019572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 927/1841] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:43.027773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34355c62-1703-42da-b8f6-f2652cb3d536 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.028154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34355c62-1703-42da-b8f6-f2652cb3d536 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.028538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34355c62-1703-42da-b8f6-f2652cb3d536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.047307 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-34355c62-1703-42da-b8f6-f2652cb3d536 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:43.053220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-34355c62-1703-42da-b8f6-f2652cb3d536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:43.056565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 915/1842] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:43.063010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844627e2-771d-4b68-b4ec-3fda2e6eb498 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.072667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844627e2-771d-4b68-b4ec-3fda2e6eb498 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.078550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ebe85-8226-4e1a-947b-d91bc87b8d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.081997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ebe85-8226-4e1a-947b-d91bc87b8d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.081997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ebe85-8226-4e1a-947b-d91bc87b8d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.081997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ebe85-8226-4e1a-947b-d91bc87b8d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.081997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ebe85-8226-4e1a-947b-d91bc87b8d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:38:43.081997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ebe85-8226-4e1a-947b-d91bc87b8d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.082988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ebe85-8226-4e1a-947b-d91bc87b8d17 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.095767 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 928/1843] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:38:43.100380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34355c62-1703-42da-b8f6-f2652cb3d536 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.111704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34355c62-1703-42da-b8f6-f2652cb3d536 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.117169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23b5a5-5cb7-40d9-8f47-9115a835f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.117893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23b5a5-5cb7-40d9-8f47-9115a835f0cc admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.118245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23b5a5-5cb7-40d9-8f47-9115a835f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.118529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23b5a5-5cb7-40d9-8f47-9115a835f0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.119237 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23b5a5-5cb7-40d9-8f47-9115a835f0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.122407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23b5a5-5cb7-40d9-8f47-9115a835f0cc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.226311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edab571-73bb-499e-8479-5d692f976bf5 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.226793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edab571-73bb-499e-8479-5d692f976bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.227190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edab571-73bb-499e-8479-5d692f976bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.253302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 916/1844] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:43 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:43.254159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23b5a5-5cb7-40d9-8f47-9115a835f0cc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.268538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-1edab571-73bb-499e-8479-5d692f976bf5 None None] MFA Rules not processed for user `243514f3745f4102a29bb2fb7820f4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:43.270277 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1edab571-73bb-499e-8479-5d692f976bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:43.337959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23b5a5-5cb7-40d9-8f47-9115a835f0cc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.340403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 929/1845] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:43.344840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edab571-73bb-499e-8479-5d692f976bf5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.345471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6803625-3c1f-486c-97ec-ebc296c94a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.346158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6803625-3c1f-486c-97ec-ebc296c94a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.346463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6803625-3c1f-486c-97ec-ebc296c94a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.346562 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1edab571-73bb-499e-8479-5d692f976bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:43.346718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6803625-3c1f-486c-97ec-ebc296c94a7d admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.347430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6803625-3c1f-486c-97ec-ebc296c94a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.349579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6803625-3c1f-486c-97ec-ebc296c94a7d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.360882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edab571-73bb-499e-8479-5d692f976bf5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.365630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf64a6-1282-4704-afa6-04a42b69a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.366290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf64a6-1282-4704-afa6-04a42b69a458 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.366593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf64a6-1282-4704-afa6-04a42b69a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.366856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf64a6-1282-4704-afa6-04a42b69a458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.367550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf64a6-1282-4704-afa6-04a42b69a458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.369542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf64a6-1282-4704-afa6-04a42b69a458 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.421119 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 917/1846] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:43 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:43.422224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6803625-3c1f-486c-97ec-ebc296c94a7d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.431954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6803625-3c1f-486c-97ec-ebc296c94a7d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.437234 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647964d-7caf-4ef8-91ff-4c3102e09da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.438010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647964d-7caf-4ef8-91ff-4c3102e09da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.438218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647964d-7caf-4ef8-91ff-4c3102e09da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.438570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647964d-7caf-4ef8-91ff-4c3102e09da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.439306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647964d-7caf-4ef8-91ff-4c3102e09da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.441033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647964d-7caf-4ef8-91ff-4c3102e09da7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.445944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 930/1847] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:43 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:43.446927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf64a6-1282-4704-afa6-04a42b69a458 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.452044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 918/1848] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:38:43.455712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647964d-7caf-4ef8-91ff-4c3102e09da7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.465956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647964d-7caf-4ef8-91ff-4c3102e09da7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.509985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf64a6-1282-4704-afa6-04a42b69a458 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.515691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e93b-3349-414e-b0a4-9fe8d9d658d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.516528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e93b-3349-414e-b0a4-9fe8d9d658d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.516821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e93b-3349-414e-b0a4-9fe8d9d658d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.517149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e93b-3349-414e-b0a4-9fe8d9d658d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.517900 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e93b-3349-414e-b0a4-9fe8d9d658d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.519969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e93b-3349-414e-b0a4-9fe8d9d658d7 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.521284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e9a6-ef5b-4f3d-8bc7-8de8fecdfe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.521966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e9a6-ef5b-4f3d-8bc7-8de8fecdfe38 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.522247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e9a6-ef5b-4f3d-8bc7-8de8fecdfe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.522528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e9a6-ef5b-4f3d-8bc7-8de8fecdfe38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.523358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e9a6-ef5b-4f3d-8bc7-8de8fecdfe38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.524935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e9a6-ef5b-4f3d-8bc7-8de8fecdfe38 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.535763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 919/1849] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:43.539916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e9a6-ef5b-4f3d-8bc7-8de8fecdfe38 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.550850 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e9a6-ef5b-4f3d-8bc7-8de8fecdfe38 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.554500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f77541-cb7d-4087-b47c-51bca61eccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.555416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f77541-cb7d-4087-b47c-51bca61eccfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.555702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f77541-cb7d-4087-b47c-51bca61eccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.555980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f77541-cb7d-4087-b47c-51bca61eccfc admin admin] PATH_INFO: `/v3/projects/88938ea10a23478f86bfc44caa77660b/users/f3c14f7a478d428591795939a9ffba4a/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.570686 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f77541-cb7d-4087-b47c-51bca61eccfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=88938ea10a23478f86bfc44caa77660b, user_id=f3c14f7a478d428591795939a9ffba4a, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.573478 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f77541-cb7d-4087-b47c-51bca61eccfc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.643433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 931/1850] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:43 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:38:43.647661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e93b-3349-414e-b0a4-9fe8d9d658d7 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.659354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e93b-3349-414e-b0a4-9fe8d9d658d7 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.664214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d06a97-525d-4aae-91f7-b80e08e1e143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.664879 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d06a97-525d-4aae-91f7-b80e08e1e143 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.665164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d06a97-525d-4aae-91f7-b80e08e1e143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.665487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d06a97-525d-4aae-91f7-b80e08e1e143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.666216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d06a97-525d-4aae-91f7-b80e08e1e143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.668545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d06a97-525d-4aae-91f7-b80e08e1e143 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.680083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 932/1851] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:38:43.691439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d06a97-525d-4aae-91f7-b80e08e1e143 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.702530 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d06a97-525d-4aae-91f7-b80e08e1e143 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.708193 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c0519-2bf7-4373-b4ae-be20a0b45c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.710158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0519-2bf7-4373-b4ae-be20a0b45c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.710158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0519-2bf7-4373-b4ae-be20a0b45c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.710158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0519-2bf7-4373-b4ae-be20a0b45c28 admin admin] PATH_INFO: `/v3/projects/7a642b9a32264ec7bc99453ed33ad4ff/users/9690317aef1740c79bdb1553ce33fc8a/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.719274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 920/1852] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:43 2022] PUT /identity/v3/projects/88938ea10a23478f86bfc44caa77660b/users/f3c14f7a478d428591795939a9ffba4a/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:38:43.724093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf0b4-6142-482f-b10f-0a34c9e04f13 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.724388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf0b4-6142-482f-b10f-0a34c9e04f13 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.724672 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf0b4-6142-482f-b10f-0a34c9e04f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.726263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c0519-2bf7-4373-b4ae-be20a0b45c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a642b9a32264ec7bc99453ed33ad4ff, user_id=9690317aef1740c79bdb1553ce33fc8a, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.728911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c0519-2bf7-4373-b4ae-be20a0b45c28 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.752850 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4ceaf0b4-6142-482f-b10f-0a34c9e04f13 None None] MFA Rules not processed for user `f3c14f7a478d428591795939a9ffba4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:43.754102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4ceaf0b4-6142-482f-b10f-0a34c9e04f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:43.814350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 933/1853] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:43 2022] PUT /identity/v3/projects/7a642b9a32264ec7bc99453ed33ad4ff/users/9690317aef1740c79bdb1553ce33fc8a/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:38:43.818333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c0519-2bf7-4373-b4ae-be20a0b45c28 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.819269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 921/1854] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:43.830280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf0b4-6142-482f-b10f-0a34c9e04f13 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.832187 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4ceaf0b4-6142-482f-b10f-0a34c9e04f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:43.902503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c0519-2bf7-4373-b4ae-be20a0b45c28 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.907910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf0b4-6142-482f-b10f-0a34c9e04f13 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.909094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36488a-d076-4553-9f2e-4ab77307519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.910023 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36488a-d076-4553-9f2e-4ab77307519a admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.910271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36488a-d076-4553-9f2e-4ab77307519a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.910554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36488a-d076-4553-9f2e-4ab77307519a admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.911288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36488a-d076-4553-9f2e-4ab77307519a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.912964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36488a-d076-4553-9f2e-4ab77307519a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.924327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 934/1855] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:43.928374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36488a-d076-4553-9f2e-4ab77307519a admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:43.938419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36488a-d076-4553-9f2e-4ab77307519a admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:43.943161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb6b87-407e-4379-a97f-00e285c0e393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.945187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb6b87-407e-4379-a97f-00e285c0e393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.945187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb6b87-407e-4379-a97f-00e285c0e393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.945187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb6b87-407e-4379-a97f-00e285c0e393 admin admin] PATH_INFO: `/v3/projects/7a642b9a32264ec7bc99453ed33ad4ff/users/9690317aef1740c79bdb1553ce33fc8a/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:43.946810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb6b87-407e-4379-a97f-00e285c0e393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a642b9a32264ec7bc99453ed33ad4ff, user_id=9690317aef1740c79bdb1553ce33fc8a, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:43.949661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb6b87-407e-4379-a97f-00e285c0e393 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:43.960043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 935/1856] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:43 2022] PUT /identity/v3/projects/7a642b9a32264ec7bc99453ed33ad4ff/users/9690317aef1740c79bdb1553ce33fc8a/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:38:43.961286 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6337eef-e844-4c34-bf2a-5edb1d1e7b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:43.962016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337eef-e844-4c34-bf2a-5edb1d1e7b26 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:43.962309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337eef-e844-4c34-bf2a-5edb1d1e7b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:43.962584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337eef-e844-4c34-bf2a-5edb1d1e7b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:44.019860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6337eef-e844-4c34-bf2a-5edb1d1e7b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:44.021293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6337eef-e844-4c34-bf2a-5edb1d1e7b26 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:44.031556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 922/1857] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:38:44.052806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb6b87-407e-4379-a97f-00e285c0e393 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:44.114451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb6b87-407e-4379-a97f-00e285c0e393 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:44.119322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:44.120198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:44.120642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:44.121306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] PATH_INFO: `/v3/users/f3c14f7a478d428591795939a9ffba4a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:44.122259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c14f7a478d428591795939a9ffba4a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:44.124177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:44.378485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c14f7a478d428591795939a9ffba4a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:44.379135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c14f7a478d428591795939a9ffba4a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:44.379744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c14f7a478d428591795939a9ffba4a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:44.392437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c14f7a478d428591795939a9ffba4a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:44.399066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c14f7a478d428591795939a9ffba4a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:44.509502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 936/1858] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:44 2022] DELETE /identity/v3/users/f3c14f7a478d428591795939a9ffba4a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:44.516067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34492fb2-5d3c-41a6-b47d-839dfb751f61 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:44.517035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34492fb2-5d3c-41a6-b47d-839dfb751f61 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:44.517555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34492fb2-5d3c-41a6-b47d-839dfb751f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:44.538767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-34492fb2-5d3c-41a6-b47d-839dfb751f61 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:44.540115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-34492fb2-5d3c-41a6-b47d-839dfb751f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:44.602162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 923/1859] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:44.614864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:44.616271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:44.675350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b53c1-7f2e-45ae-8ef0-f61b0c0c9447 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:44.679346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033cf6-dabe-4507-8174-46a196197b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:44.680178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033cf6-dabe-4507-8174-46a196197b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:44.680461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033cf6-dabe-4507-8174-46a196197b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:44.680741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033cf6-dabe-4507-8174-46a196197b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:44.690726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94033cf6-dabe-4507-8174-46a196197b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:44.692423 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94033cf6-dabe-4507-8174-46a196197b98 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:44.701970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 937/1860] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:45.343306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34492fb2-5d3c-41a6-b47d-839dfb751f61 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:45.353262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-34492fb2-5d3c-41a6-b47d-839dfb751f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:45.369912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34492fb2-5d3c-41a6-b47d-839dfb751f61 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:45.378643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:45.379625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:45.379975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:45.380323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] PATH_INFO: `/v3/projects/88938ea10a23478f86bfc44caa77660b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:45.382327 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=88938ea10a23478f86bfc44caa77660b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:45.385815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:45.437143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b29be-a9f4-4c62-bcec-7dbfcd3e51ef None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:45.437808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b29be-a9f4-4c62-bcec-7dbfcd3e51ef None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:45.437808 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b29be-a9f4-4c62-bcec-7dbfcd3e51ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:45.470852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-410b29be-a9f4-4c62-bcec-7dbfcd3e51ef None None] MFA Rules not processed for user `9690317aef1740c79bdb1553ce33fc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:45.472050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-410b29be-a9f4-4c62-bcec-7dbfcd3e51ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:45.539003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88938ea10a23478f86bfc44caa77660b', 'request_id': 'req-954f5a79-5c82-42ac-8a42-22294ca6a9ec'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:45.543190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 938/1861] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:45.545864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88938ea10a23478f86bfc44caa77660b', 'request_id': 'req-954f5a79-5c82-42ac-8a42-22294ca6a9ec'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:45.556468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b29be-a9f4-4c62-bcec-7dbfcd3e51ef None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:45.557989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-410b29be-a9f4-4c62-bcec-7dbfcd3e51ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:45.614210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88938ea10a23478f86bfc44caa77660b', 'request_id': 'req-954f5a79-5c82-42ac-8a42-22294ca6a9ec'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:45.617039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b29be-a9f4-4c62-bcec-7dbfcd3e51ef None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:45.627447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] The token cache is being invalidate because project 88938ea10a23478f86bfc44caa77660b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:45.628064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:45.629035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-954f5a79-5c82-42ac-8a42-22294ca6a9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:45.635336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 924/1862] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:45 2022] DELETE /identity/v3/projects/88938ea10a23478f86bfc44caa77660b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:45.637937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ff94-90c3-47ad-8635-b2245661124c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:45.638442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ff94-90c3-47ad-8635-b2245661124c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:45.638930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ff94-90c3-47ad-8635-b2245661124c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:45.660172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7c42ff94-90c3-47ad-8635-b2245661124c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:45.661464 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7c42ff94-90c3-47ad-8635-b2245661124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:45.689652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850ee1c-3fa3-4394-8c1c-cc641e09f89d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:45.690326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850ee1c-3fa3-4394-8c1c-cc641e09f89d service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:45.690604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850ee1c-3fa3-4394-8c1c-cc641e09f89d service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:45.691157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850ee1c-3fa3-4394-8c1c-cc641e09f89d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:45.693488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5850ee1c-3fa3-4394-8c1c-cc641e09f89d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:45.725823 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 925/1863] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:45.733736 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c7fc-4940-4dd8-bba6-364eaab07382 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:45.733736 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c7fc-4940-4dd8-bba6-364eaab07382 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:45.734037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c7fc-4940-4dd8-bba6-364eaab07382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:45.751683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6d63c7fc-4940-4dd8-bba6-364eaab07382 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:45.753155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6d63c7fc-4940-4dd8-bba6-364eaab07382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:45.760047 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850ee1c-3fa3-4394-8c1c-cc641e09f89d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:45.761715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 926/1864] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:45.762524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850ee1c-3fa3-4394-8c1c-cc641e09f89d service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:45.765860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63c7fc-4940-4dd8-bba6-364eaab07382 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:45.772163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 939/1865] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:38:45.774842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63c7fc-4940-4dd8-bba6-364eaab07382 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:45.781233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db69bd4-6ace-4bf7-8a8c-04d98c679e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:45.781233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db69bd4-6ace-4bf7-8a8c-04d98c679e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:45.781445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db69bd4-6ace-4bf7-8a8c-04d98c679e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:45.781631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db69bd4-6ace-4bf7-8a8c-04d98c679e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:45.782366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db69bd4-6ace-4bf7-8a8c-04d98c679e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:38:45.782683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db69bd4-6ace-4bf7-8a8c-04d98c679e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:45.784280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db69bd4-6ace-4bf7-8a8c-04d98c679e6a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:45.799246 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 927/1866] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:38:45.800392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850ee1c-3fa3-4394-8c1c-cc641e09f89d service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:45.810952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850ee1c-3fa3-4394-8c1c-cc641e09f89d service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:45.815504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e7eee-2ff0-46c6-8a57-433a4d237ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:45.816158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e7eee-2ff0-46c6-8a57-433a4d237ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:45.816443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e7eee-2ff0-46c6-8a57-433a4d237ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:45.816718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e7eee-2ff0-46c6-8a57-433a4d237ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:45.817455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e7eee-2ff0-46c6-8a57-433a4d237ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:45.819432 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e7eee-2ff0-46c6-8a57-433a4d237ce9 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:45.898565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 940/1867] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:45 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:45.899834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db69bd4-6ace-4bf7-8a8c-04d98c679e6a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:45.910580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db69bd4-6ace-4bf7-8a8c-04d98c679e6a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:45.966403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d1d6b-8227-4aa9-b7bf-aa9e46171fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:45.967079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d1d6b-8227-4aa9-b7bf-aa9e46171fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:45.967363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d1d6b-8227-4aa9-b7bf-aa9e46171fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:45.967642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d1d6b-8227-4aa9-b7bf-aa9e46171fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:45.968364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d1d6b-8227-4aa9-b7bf-aa9e46171fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:45.970304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d1d6b-8227-4aa9-b7bf-aa9e46171fb2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:46.088022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 928/1868] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:45 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:46.098217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e7eee-2ff0-46c6-8a57-433a4d237ce9 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:46.108459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e7eee-2ff0-46c6-8a57-433a4d237ce9 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:46.113383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128ad65-af32-4848-b766-e39e10fd26dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:46.114064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128ad65-af32-4848-b766-e39e10fd26dc admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:46.114346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128ad65-af32-4848-b766-e39e10fd26dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:46.114724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128ad65-af32-4848-b766-e39e10fd26dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:46.115457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128ad65-af32-4848-b766-e39e10fd26dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:46.121152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128ad65-af32-4848-b766-e39e10fd26dc admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:46.133516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 941/1869] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:46.137987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d1d6b-8227-4aa9-b7bf-aa9e46171fb2 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:46.148239 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d1d6b-8227-4aa9-b7bf-aa9e46171fb2 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:46.152907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95a438-a0d2-4045-8f87-751e7d1c388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:46.153612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95a438-a0d2-4045-8f87-751e7d1c388d admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:46.153915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95a438-a0d2-4045-8f87-751e7d1c388d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:46.154177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95a438-a0d2-4045-8f87-751e7d1c388d admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:46.154910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95a438-a0d2-4045-8f87-751e7d1c388d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:46.156491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95a438-a0d2-4045-8f87-751e7d1c388d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:46.166817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 929/1870] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:38:46.171033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128ad65-af32-4848-b766-e39e10fd26dc admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:46.180813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128ad65-af32-4848-b766-e39e10fd26dc admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:46.186306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295266d-70bb-495c-b06b-9a3fda989644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:46.187171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295266d-70bb-495c-b06b-9a3fda989644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:46.187459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295266d-70bb-495c-b06b-9a3fda989644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:46.187743 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295266d-70bb-495c-b06b-9a3fda989644 admin admin] PATH_INFO: `/v3/projects/159f1f2808a64b9190c21edefdbd6252/users/1e058e112f49495b805dc1d0a3457639/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:46.204347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295266d-70bb-495c-b06b-9a3fda989644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159f1f2808a64b9190c21edefdbd6252, user_id=1e058e112f49495b805dc1d0a3457639, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:46.207045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295266d-70bb-495c-b06b-9a3fda989644 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:46.266694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 942/1871] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:46 2022] PUT /identity/v3/projects/159f1f2808a64b9190c21edefdbd6252/users/1e058e112f49495b805dc1d0a3457639/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:46.278319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d0903-3f0f-4d73-a488-f6269664341d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:46.278567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d0903-3f0f-4d73-a488-f6269664341d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:46.278853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d0903-3f0f-4d73-a488-f6269664341d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:46.306435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9d5d0903-3f0f-4d73-a488-f6269664341d None None] MFA Rules not processed for user `1e058e112f49495b805dc1d0a3457639`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:46.307660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9d5d0903-3f0f-4d73-a488-f6269664341d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:46.385075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 930/1872] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:46.398379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295266d-70bb-495c-b06b-9a3fda989644 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:46.400200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c295266d-70bb-495c-b06b-9a3fda989644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:46.470249 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295266d-70bb-495c-b06b-9a3fda989644 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:46.475366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0199936-c82d-4283-9c66-e442907e4933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:46.475366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0199936-c82d-4283-9c66-e442907e4933 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:46.475366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0199936-c82d-4283-9c66-e442907e4933 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:46.476134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0199936-c82d-4283-9c66-e442907e4933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:46.488306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0199936-c82d-4283-9c66-e442907e4933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:46.489784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0199936-c82d-4283-9c66-e442907e4933 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:46.512186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 943/1873] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:46.523249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d0903-3f0f-4d73-a488-f6269664341d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:46.590789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d0903-3f0f-4d73-a488-f6269664341d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:46.595647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:46.596531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:46.596818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:46.597099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] PATH_INFO: `/v3/users/1e058e112f49495b805dc1d0a3457639` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:46.598350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e058e112f49495b805dc1d0a3457639)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:46.600265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:46.840612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e058e112f49495b805dc1d0a3457639'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:46.853873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e058e112f49495b805dc1d0a3457639'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:46.855422 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e058e112f49495b805dc1d0a3457639'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:46.921083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e058e112f49495b805dc1d0a3457639'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:46.928948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e058e112f49495b805dc1d0a3457639'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:46.935018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 931/1874] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:38:46 2022] DELETE /identity/v3/users/1e058e112f49495b805dc1d0a3457639 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:46.939458 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aee506-08dd-485c-8038-18247d30e6bd None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:46.940386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aee506-08dd-485c-8038-18247d30e6bd None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:46.940386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aee506-08dd-485c-8038-18247d30e6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:46.958376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d8aee506-08dd-485c-8038-18247d30e6bd None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:46.959606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d8aee506-08dd-485c-8038-18247d30e6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:47.017388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 944/1875] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:47.027448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:47.029025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:47.085125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4207335-a5cf-45a4-a255-6f9a43dc177a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:47.089928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860471c8-4657-4163-9d4a-eb0c84d33d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:47.090688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860471c8-4657-4163-9d4a-eb0c84d33d67 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:47.090982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860471c8-4657-4163-9d4a-eb0c84d33d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:47.091267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860471c8-4657-4163-9d4a-eb0c84d33d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:47.100634 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860471c8-4657-4163-9d4a-eb0c84d33d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:47.102189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860471c8-4657-4163-9d4a-eb0c84d33d67 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:47.113879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 932/1876] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:47.559158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aee506-08dd-485c-8038-18247d30e6bd None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:47.560928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d8aee506-08dd-485c-8038-18247d30e6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:47.576516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aee506-08dd-485c-8038-18247d30e6bd None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:47.601762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:47.602664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:47.603033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:47.603336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] PATH_INFO: `/v3/projects/159f1f2808a64b9190c21edefdbd6252` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:47.605702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] RBAC: Authorizing `identity:delete_project(project_id=159f1f2808a64b9190c21edefdbd6252)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:47.607728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:47.793816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159f1f2808a64b9190c21edefdbd6252', 'request_id': 'req-cce16970-cfb4-44a8-afeb-908819bcffca'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:47.802164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159f1f2808a64b9190c21edefdbd6252', 'request_id': 'req-cce16970-cfb4-44a8-afeb-908819bcffca'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:47.876519 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159f1f2808a64b9190c21edefdbd6252', 'request_id': 'req-cce16970-cfb4-44a8-afeb-908819bcffca'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:47.890729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] The token cache is being invalidate because project 159f1f2808a64b9190c21edefdbd6252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:38:47.891263 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:47.892017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-cce16970-cfb4-44a8-afeb-908819bcffca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:38:47.894260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 945/1877] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:38:47 2022] DELETE /identity/v3/projects/159f1f2808a64b9190c21edefdbd6252 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:47.898956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2e93-35b4-4822-ac92-72a75f791869 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:47.899456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2e93-35b4-4822-ac92-72a75f791869 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:47.899534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2e93-35b4-4822-ac92-72a75f791869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:47.919818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f8fe2e93-35b4-4822-ac92-72a75f791869 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:47.921345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f8fe2e93-35b4-4822-ac92-72a75f791869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:47.985205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 933/1878] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:38:47.992889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049de28-184e-4c3f-9b15-841fbcd1fe17 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:47.993259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049de28-184e-4c3f-9b15-841fbcd1fe17 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:47.993666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049de28-184e-4c3f-9b15-841fbcd1fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:48.014259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-b049de28-184e-4c3f-9b15-841fbcd1fe17 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:48.015592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b049de28-184e-4c3f-9b15-841fbcd1fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:48.025806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 946/1879] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:48.030178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2e93-35b4-4822-ac92-72a75f791869 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:48.040375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2e93-35b4-4822-ac92-72a75f791869 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:48.046659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0598-2195-4407-a658-9ab01d806db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:48.047537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0598-2195-4407-a658-9ab01d806db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:48.047827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0598-2195-4407-a658-9ab01d806db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:48.048110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0598-2195-4407-a658-9ab01d806db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:48.050124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0598-2195-4407-a658-9ab01d806db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:38:48.050729 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0598-2195-4407-a658-9ab01d806db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:48.052625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0598-2195-4407-a658-9ab01d806db5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:48.066371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 934/1880] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:38:48.070455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049de28-184e-4c3f-9b15-841fbcd1fe17 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:48.079780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049de28-184e-4c3f-9b15-841fbcd1fe17 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:48.085006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159984e-5b58-4529-9102-340ef7e0eb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:48.085826 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159984e-5b58-4529-9102-340ef7e0eb67 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:48.086218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159984e-5b58-4529-9102-340ef7e0eb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:48.086360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159984e-5b58-4529-9102-340ef7e0eb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:48.086957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159984e-5b58-4529-9102-340ef7e0eb67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:48.088911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159984e-5b58-4529-9102-340ef7e0eb67 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:48.178187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 947/1881] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:38:48 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:38:48.178979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0598-2195-4407-a658-9ab01d806db5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:48.192158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0598-2195-4407-a658-9ab01d806db5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:48.258963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377b296-49f7-4e3a-8988-8c959a907654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:48.259696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b296-49f7-4e3a-8988-8c959a907654 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:48.260159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b296-49f7-4e3a-8988-8c959a907654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:48.260498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b296-49f7-4e3a-8988-8c959a907654 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:48.262331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377b296-49f7-4e3a-8988-8c959a907654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:48.263280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377b296-49f7-4e3a-8988-8c959a907654 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:48.379563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 935/1882] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:38:48 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:38:48.380566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159984e-5b58-4529-9102-340ef7e0eb67 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:48.393742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159984e-5b58-4529-9102-340ef7e0eb67 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:48.398380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f71f-30a4-4ff5-990d-7bc3af84abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:48.399054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f71f-30a4-4ff5-990d-7bc3af84abe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:48.399343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f71f-30a4-4ff5-990d-7bc3af84abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:48.399623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f71f-30a4-4ff5-990d-7bc3af84abe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:48.400384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359f71f-30a4-4ff5-990d-7bc3af84abe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:48.402132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359f71f-30a4-4ff5-990d-7bc3af84abe5 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:48.417195 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 948/1883] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:38:48.418782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377b296-49f7-4e3a-8988-8c959a907654 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:48.428735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377b296-49f7-4e3a-8988-8c959a907654 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:48.434661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d915787-5962-4acd-8432-82319532bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:48.435350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d915787-5962-4acd-8432-82319532bb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:48.435636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d915787-5962-4acd-8432-82319532bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:48.435914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d915787-5962-4acd-8432-82319532bb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:48.436645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d915787-5962-4acd-8432-82319532bb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:48.438277 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d915787-5962-4acd-8432-82319532bb85 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:48.449464 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 936/1884] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:38:48.455186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f71f-30a4-4ff5-990d-7bc3af84abe5 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:48.466288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f71f-30a4-4ff5-990d-7bc3af84abe5 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:48.471625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d61bc4-20e2-4984-aaa6-69d863714971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:48.472771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d61bc4-20e2-4984-aaa6-69d863714971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:48.473262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d61bc4-20e2-4984-aaa6-69d863714971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:48.473950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d61bc4-20e2-4984-aaa6-69d863714971 admin admin] PATH_INFO: `/v3/projects/b1d2c351603146b1bb34383f36b81cde/users/fa21cdd2fb2241788c9100d22ca1fdc0/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:48.489790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d61bc4-20e2-4984-aaa6-69d863714971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d2c351603146b1bb34383f36b81cde, user_id=fa21cdd2fb2241788c9100d22ca1fdc0, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:48.493158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d61bc4-20e2-4984-aaa6-69d863714971 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:48.627881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 949/1885] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:38:48 2022] PUT /identity/v3/projects/b1d2c351603146b1bb34383f36b81cde/users/fa21cdd2fb2241788c9100d22ca1fdc0/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:38:48.639705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139964a-ef90-4138-9cbd-417fd064a135 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:48.639830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139964a-ef90-4138-9cbd-417fd064a135 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:48.640009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139964a-ef90-4138-9cbd-417fd064a135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:48.674703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3139964a-ef90-4138-9cbd-417fd064a135 None None] MFA Rules not processed for user `fa21cdd2fb2241788c9100d22ca1fdc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:38:48.675999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3139964a-ef90-4138-9cbd-417fd064a135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:48.746282 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 937/1886] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:38:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:38:48.759822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d61bc4-20e2-4984-aaa6-69d863714971 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:48.761865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d9d61bc4-20e2-4984-aaa6-69d863714971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:48.829367 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d61bc4-20e2-4984-aaa6-69d863714971 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:48.834244 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b45ad7-82e1-49cf-b792-36f7d9513b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:48.835182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b45ad7-82e1-49cf-b792-36f7d9513b35 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:48.835369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b45ad7-82e1-49cf-b792-36f7d9513b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:48.835670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b45ad7-82e1-49cf-b792-36f7d9513b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:48.846500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b45ad7-82e1-49cf-b792-36f7d9513b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:48.852488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b45ad7-82e1-49cf-b792-36f7d9513b35 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:48.859368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 950/1887] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:38:49.624254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139964a-ef90-4138-9cbd-417fd064a135 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:38:49.635954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139964a-ef90-4138-9cbd-417fd064a135 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:38:49.643201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae99d84-0cf0-4d7a-92f7-0b6c7b905597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:38:49.644012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99d84-0cf0-4d7a-92f7-0b6c7b905597 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:38:49.644372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99d84-0cf0-4d7a-92f7-0b6c7b905597 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:38:49.644725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99d84-0cf0-4d7a-92f7-0b6c7b905597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:38:49.647072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2ae99d84-0cf0-4d7a-92f7-0b6c7b905597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:38:49.720890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae99d84-0cf0-4d7a-92f7-0b6c7b905597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:38:49.722361 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae99d84-0cf0-4d7a-92f7-0b6c7b905597 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:38:49.732667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 938/1888] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:38:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:00.124501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b45ad7-82e1-49cf-b792-36f7d9513b35 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:00.191033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b45ad7-82e1-49cf-b792-36f7d9513b35 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:00.195981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:00.196851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:00.197208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:00.197591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] PATH_INFO: `/v3/users/fa21cdd2fb2241788c9100d22ca1fdc0` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:00.198874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa21cdd2fb2241788c9100d22ca1fdc0)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:00.201683 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:00.369830 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa21cdd2fb2241788c9100d22ca1fdc0'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:00.370495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa21cdd2fb2241788c9100d22ca1fdc0'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:00.371082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa21cdd2fb2241788c9100d22ca1fdc0'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:00.383679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa21cdd2fb2241788c9100d22ca1fdc0'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:00.391451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa21cdd2fb2241788c9100d22ca1fdc0'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:00.463602 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 951/1889] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:00 2022] DELETE /identity/v3/users/fa21cdd2fb2241788c9100d22ca1fdc0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:00.473470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3af17-2020-4a11-8476-caea155e1b3d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:00.473993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3af17-2020-4a11-8476-caea155e1b3d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:00.474089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3af17-2020-4a11-8476-caea155e1b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:00.491788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-32a3af17-2020-4a11-8476-caea155e1b3d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:00.498892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-32a3af17-2020-4a11-8476-caea155e1b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:00.552250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 939/1890] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:00.562527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:00.563904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:00.619989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e3167-8b8d-4dbc-889c-25d81551ac3f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:00.624587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c213f-cfd4-4082-b38d-836c7bcf7631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:00.625246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c213f-cfd4-4082-b38d-836c7bcf7631 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:00.625567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c213f-cfd4-4082-b38d-836c7bcf7631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:00.625850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c213f-cfd4-4082-b38d-836c7bcf7631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:00.635242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c213f-cfd4-4082-b38d-836c7bcf7631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:00.636671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c213f-cfd4-4082-b38d-836c7bcf7631 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:00.646350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 952/1891] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:01.128921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3af17-2020-4a11-8476-caea155e1b3d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:01.130890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-32a3af17-2020-4a11-8476-caea155e1b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:01.167394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3af17-2020-4a11-8476-caea155e1b3d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:01.180655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:01.182765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:01.183056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:01.183340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] PATH_INFO: `/v3/projects/b1d2c351603146b1bb34383f36b81cde` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:01.187603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1d2c351603146b1bb34383f36b81cde)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:01.195095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:01.311959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d2c351603146b1bb34383f36b81cde', 'request_id': 'req-e6a84d7c-8d47-4691-a108-83fe87d28c5f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:01.317653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d2c351603146b1bb34383f36b81cde', 'request_id': 'req-e6a84d7c-8d47-4691-a108-83fe87d28c5f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:01.384644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d2c351603146b1bb34383f36b81cde', 'request_id': 'req-e6a84d7c-8d47-4691-a108-83fe87d28c5f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:01.396550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] The token cache is being invalidate because project b1d2c351603146b1bb34383f36b81cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:01.396840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:01.397496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e6a84d7c-8d47-4691-a108-83fe87d28c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:01.399039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 940/1892] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:01 2022] DELETE /identity/v3/projects/b1d2c351603146b1bb34383f36b81cde => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:01.404716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed33fb4-739f-4956-92ae-cda4db47c46a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:01.405345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed33fb4-739f-4956-92ae-cda4db47c46a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:01.405345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed33fb4-739f-4956-92ae-cda4db47c46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:01.423046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-4ed33fb4-739f-4956-92ae-cda4db47c46a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:01.424295 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4ed33fb4-739f-4956-92ae-cda4db47c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:01.484111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 953/1893] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:01.492899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa69c05-09fa-4320-829d-adc9b0394fd7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:01.493435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa69c05-09fa-4320-829d-adc9b0394fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:01.493527 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa69c05-09fa-4320-829d-adc9b0394fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:01.512551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0aa69c05-09fa-4320-829d-adc9b0394fd7 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:01.514868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0aa69c05-09fa-4320-829d-adc9b0394fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:01.523013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 941/1894] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:01.527366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed33fb4-739f-4956-92ae-cda4db47c46a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:01.537599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed33fb4-739f-4956-92ae-cda4db47c46a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:01.542177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e14c2a-26de-46d7-9ecf-5a0598f79054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:01.542833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e14c2a-26de-46d7-9ecf-5a0598f79054 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:01.543191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e14c2a-26de-46d7-9ecf-5a0598f79054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:01.543477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e14c2a-26de-46d7-9ecf-5a0598f79054 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:01.544224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e14c2a-26de-46d7-9ecf-5a0598f79054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:01.544641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e14c2a-26de-46d7-9ecf-5a0598f79054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:01.546256 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e14c2a-26de-46d7-9ecf-5a0598f79054 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:01.557579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 954/1895] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:39:01.562072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa69c05-09fa-4320-829d-adc9b0394fd7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:01.571266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa69c05-09fa-4320-829d-adc9b0394fd7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:01.576600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df58372-b726-4ba4-a7f1-96b605d8dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:01.577336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df58372-b726-4ba4-a7f1-96b605d8dff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:01.577734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df58372-b726-4ba4-a7f1-96b605d8dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:01.578018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df58372-b726-4ba4-a7f1-96b605d8dff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:01.578723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df58372-b726-4ba4-a7f1-96b605d8dff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:01.580625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df58372-b726-4ba4-a7f1-96b605d8dff3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:01.672418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 942/1896] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:01 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:01.676425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e14c2a-26de-46d7-9ecf-5a0598f79054 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:01.686721 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e14c2a-26de-46d7-9ecf-5a0598f79054 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:01.747217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090aad5-a72a-45ff-b85f-6c17667bb45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:01.747819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090aad5-a72a-45ff-b85f-6c17667bb45f admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:01.748667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090aad5-a72a-45ff-b85f-6c17667bb45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:01.748973 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090aad5-a72a-45ff-b85f-6c17667bb45f admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:01.749768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090aad5-a72a-45ff-b85f-6c17667bb45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:01.751726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090aad5-a72a-45ff-b85f-6c17667bb45f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:01.847882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 955/1897] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:01 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:01.851999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df58372-b726-4ba4-a7f1-96b605d8dff3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:01.862433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df58372-b726-4ba4-a7f1-96b605d8dff3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:01.867244 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c05b6-4c23-450a-80b0-f9f0e6393ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:01.867918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c05b6-4c23-450a-80b0-f9f0e6393ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:01.868203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c05b6-4c23-450a-80b0-f9f0e6393ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:01.868490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c05b6-4c23-450a-80b0-f9f0e6393ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:01.869265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c05b6-4c23-450a-80b0-f9f0e6393ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:01.870915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c05b6-4c23-450a-80b0-f9f0e6393ed9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:01.883287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 943/1898] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:01.887729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090aad5-a72a-45ff-b85f-6c17667bb45f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:01.898127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090aad5-a72a-45ff-b85f-6c17667bb45f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:01.902679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88035eeb-2e37-4165-905f-40b6a2f19e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:01.903393 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88035eeb-2e37-4165-905f-40b6a2f19e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:01.903682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88035eeb-2e37-4165-905f-40b6a2f19e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:01.903968 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88035eeb-2e37-4165-905f-40b6a2f19e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:01.904888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88035eeb-2e37-4165-905f-40b6a2f19e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:01.906520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88035eeb-2e37-4165-905f-40b6a2f19e0f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:01.916770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 956/1899] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:01.924353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c05b6-4c23-450a-80b0-f9f0e6393ed9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:01.934411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c05b6-4c23-450a-80b0-f9f0e6393ed9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:01.939753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592949-76fa-4780-b2d8-b7b0d23e8402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:01.940743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592949-76fa-4780-b2d8-b7b0d23e8402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:01.941053 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592949-76fa-4780-b2d8-b7b0d23e8402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:01.941361 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7592949-76fa-4780-b2d8-b7b0d23e8402 admin admin] PATH_INFO: `/v3/projects/789c698fde3548d6b9e3856989f95c86/users/b1677383cb414af8a1c5bbfb043f7485/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:01.957039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7592949-76fa-4780-b2d8-b7b0d23e8402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789c698fde3548d6b9e3856989f95c86, user_id=b1677383cb414af8a1c5bbfb043f7485, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:01.959833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7592949-76fa-4780-b2d8-b7b0d23e8402 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:02.071183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 944/1900] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:01 2022] PUT /identity/v3/projects/789c698fde3548d6b9e3856989f95c86/users/b1677383cb414af8a1c5bbfb043f7485/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:02.081304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec643b63-83af-4bf1-93d5-8270261d9357 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:02.081615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec643b63-83af-4bf1-93d5-8270261d9357 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:02.081901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec643b63-83af-4bf1-93d5-8270261d9357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:02.116784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-ec643b63-83af-4bf1-93d5-8270261d9357 None None] MFA Rules not processed for user `b1677383cb414af8a1c5bbfb043f7485`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:02.116784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ec643b63-83af-4bf1-93d5-8270261d9357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:02.177002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 957/1901] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:02.188554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592949-76fa-4780-b2d8-b7b0d23e8402 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:02.190346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b7592949-76fa-4780-b2d8-b7b0d23e8402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:02.246022 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7592949-76fa-4780-b2d8-b7b0d23e8402 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:02.250772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b9cf-e9bd-498e-bca1-9a7ffe162632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:02.251419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b9cf-e9bd-498e-bca1-9a7ffe162632 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:02.251705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b9cf-e9bd-498e-bca1-9a7ffe162632 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:02.252020 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b9cf-e9bd-498e-bca1-9a7ffe162632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:02.265163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075b9cf-e9bd-498e-bca1-9a7ffe162632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:02.265163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075b9cf-e9bd-498e-bca1-9a7ffe162632 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:02.273065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 945/1902] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:08.271058 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec643b63-83af-4bf1-93d5-8270261d9357 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:08.272911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ec643b63-83af-4bf1-93d5-8270261d9357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:08.347201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec643b63-83af-4bf1-93d5-8270261d9357 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:08.351717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:08.352571 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:08.352854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:08.353169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] PATH_INFO: `/v3/users/5f83f80f0bcf4856b657ffc37d3881a3` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:08.354426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f83f80f0bcf4856b657ffc37d3881a3)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:08.356329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:08.568170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f83f80f0bcf4856b657ffc37d3881a3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:08.568827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f83f80f0bcf4856b657ffc37d3881a3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:08.569457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f83f80f0bcf4856b657ffc37d3881a3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:08.581473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f83f80f0bcf4856b657ffc37d3881a3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:08.588228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f83f80f0bcf4856b657ffc37d3881a3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:08.705410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 958/1903] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:08 2022] DELETE /identity/v3/users/5f83f80f0bcf4856b657ffc37d3881a3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:08.709860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f13ded-b285-471b-86f9-3392adeac409 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:08.710375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f13ded-b285-471b-86f9-3392adeac409 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:08.710517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f13ded-b285-471b-86f9-3392adeac409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:08.727552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-21f13ded-b285-471b-86f9-3392adeac409 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:08.728704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-21f13ded-b285-471b-86f9-3392adeac409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:08.790150 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 946/1904] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:08.800879 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:08.802434 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:08.878904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5f5e-3042-44cf-944f-69fe830e21e4 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:08.880092 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f13ded-b285-471b-86f9-3392adeac409 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:08.881592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-21f13ded-b285-471b-86f9-3392adeac409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:08.884397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a055f6-7e49-4581-98f7-0edea1315306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:08.885079 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a055f6-7e49-4581-98f7-0edea1315306 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:08.885393 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a055f6-7e49-4581-98f7-0edea1315306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:08.885675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a055f6-7e49-4581-98f7-0edea1315306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:08.894103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f13ded-b285-471b-86f9-3392adeac409 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:08.897087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a055f6-7e49-4581-98f7-0edea1315306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:08.898909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a055f6-7e49-4581-98f7-0edea1315306 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:08.900341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80581435-db44-466e-af2c-52209e240710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:08.901224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80581435-db44-466e-af2c-52209e240710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:08.901549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80581435-db44-466e-af2c-52209e240710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:08.901832 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80581435-db44-466e-af2c-52209e240710 admin admin] PATH_INFO: `/v3/users/b1677383cb414af8a1c5bbfb043f7485` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:08.903181 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80581435-db44-466e-af2c-52209e240710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1677383cb414af8a1c5bbfb043f7485)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:08.905166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80581435-db44-466e-af2c-52209e240710 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:08.919787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 959/1905] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:09.130617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80581435-db44-466e-af2c-52209e240710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1677383cb414af8a1c5bbfb043f7485'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:09.143849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80581435-db44-466e-af2c-52209e240710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1677383cb414af8a1c5bbfb043f7485'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:09.149763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80581435-db44-466e-af2c-52209e240710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1677383cb414af8a1c5bbfb043f7485'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:09.270971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80581435-db44-466e-af2c-52209e240710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1677383cb414af8a1c5bbfb043f7485'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:09.278125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-80581435-db44-466e-af2c-52209e240710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1677383cb414af8a1c5bbfb043f7485'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:09.284845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 947/1906] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:08 2022] DELETE /identity/v3/users/b1677383cb414af8a1c5bbfb043f7485 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:09.289461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034776a-752b-4bb6-b48b-039a6a98e891 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:09.289970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034776a-752b-4bb6-b48b-039a6a98e891 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:09.290081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034776a-752b-4bb6-b48b-039a6a98e891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:09.308216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a034776a-752b-4bb6-b48b-039a6a98e891 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:09.309477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a034776a-752b-4bb6-b48b-039a6a98e891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:09.365110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80581435-db44-466e-af2c-52209e240710 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:09.367374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-80581435-db44-466e-af2c-52209e240710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:09.369485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 960/1907] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:09.383506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80581435-db44-466e-af2c-52209e240710 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:09.383918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034776a-752b-4bb6-b48b-039a6a98e891 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:09.385430 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a034776a-752b-4bb6-b48b-039a6a98e891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:09.398645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:09.399537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:09.399825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:09.400140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] PATH_INFO: `/v3/projects/da06f4c1da4e4a8088dd3c348a304340` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:09.401592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da06f4c1da4e4a8088dd3c348a304340)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:09.403578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:09.444312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034776a-752b-4bb6-b48b-039a6a98e891 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:09.448218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166ccc-9e9e-4a36-9914-7db986a365ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:09.448870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166ccc-9e9e-4a36-9914-7db986a365ad service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:09.449155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166ccc-9e9e-4a36-9914-7db986a365ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:09.449465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166ccc-9e9e-4a36-9914-7db986a365ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:09.459975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d166ccc-9e9e-4a36-9914-7db986a365ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:09.461497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d166ccc-9e9e-4a36-9914-7db986a365ad service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:09.471715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 961/1908] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:39:09.559075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da06f4c1da4e4a8088dd3c348a304340', 'request_id': 'req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:09.567470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da06f4c1da4e4a8088dd3c348a304340', 'request_id': 'req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:09.693329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da06f4c1da4e4a8088dd3c348a304340', 'request_id': 'req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:09.705941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] The token cache is being invalidate because project da06f4c1da4e4a8088dd3c348a304340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:09.706251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:09.707494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:09.708919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 948/1909] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:09 2022] DELETE /identity/v3/projects/da06f4c1da4e4a8088dd3c348a304340 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:09.712900 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166ccc-9e9e-4a36-9914-7db986a365ad service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:09.723941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166ccc-9e9e-4a36-9914-7db986a365ad service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:09.784513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:09.785433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:09.785637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:09.785908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] PATH_INFO: `/v3/users/3b69f1943b9c47778fb790e386dda57c` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:09.787101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b69f1943b9c47778fb790e386dda57c)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:09.789017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:09.952464 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:09.954798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:09.973619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91933e84-2669-4bc0-8cd7-87fffb0c3f8c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:09.987149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:09.988964 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:09.989254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:09.989580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] PATH_INFO: `/v3/projects/789c698fde3548d6b9e3856989f95c86` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:09.995975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=789c698fde3548d6b9e3856989f95c86)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:09.995975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:10.007337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b69f1943b9c47778fb790e386dda57c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.008798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b69f1943b9c47778fb790e386dda57c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.011413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b69f1943b9c47778fb790e386dda57c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.036617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b69f1943b9c47778fb790e386dda57c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.044755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-b3532e8a-a794-4cf0-9662-21f252b2e157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b69f1943b9c47778fb790e386dda57c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.106985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789c698fde3548d6b9e3856989f95c86', 'request_id': 'req-5389f1c1-d534-4420-8f12-0cce88556a28'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.113188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789c698fde3548d6b9e3856989f95c86', 'request_id': 'req-5389f1c1-d534-4420-8f12-0cce88556a28'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.124856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 962/1910] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:09 2022] DELETE /identity/v3/users/3b69f1943b9c47778fb790e386dda57c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:10.196876 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789c698fde3548d6b9e3856989f95c86', 'request_id': 'req-5389f1c1-d534-4420-8f12-0cce88556a28'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.210221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] The token cache is being invalidate because project 789c698fde3548d6b9e3856989f95c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:10.210542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.211406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-5389f1c1-d534-4420-8f12-0cce88556a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.213757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 949/1911] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:09 2022] DELETE /identity/v3/projects/789c698fde3548d6b9e3856989f95c86 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:39:10.218846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9b135-1fcb-42d9-bc65-e878c61e3efb None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.219652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9b135-1fcb-42d9-bc65-e878c61e3efb None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.219941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9b135-1fcb-42d9-bc65-e878c61e3efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.248817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-57b9b135-1fcb-42d9-bc65-e878c61e3efb None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:10.250449 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-57b9b135-1fcb-42d9-bc65-e878c61e3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:10.316264 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 963/1912] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:10.324796 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f49d-aa13-4311-92b4-a5ffc7343c08 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.325229 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f49d-aa13-4311-92b4-a5ffc7343c08 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.325578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f49d-aa13-4311-92b4-a5ffc7343c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.346782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e933f49d-aa13-4311-92b4-a5ffc7343c08 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:10.348021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e933f49d-aa13-4311-92b4-a5ffc7343c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:10.361480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 950/1913] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:10.364797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9b135-1fcb-42d9-bc65-e878c61e3efb None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:10.377036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9b135-1fcb-42d9-bc65-e878c61e3efb None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:10.385685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20859071-c665-43f6-ad91-7a29490c5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:10.386599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20859071-c665-43f6-ad91-7a29490c5992 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.387039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20859071-c665-43f6-ad91-7a29490c5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.387469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20859071-c665-43f6-ad91-7a29490c5992 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.388788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20859071-c665-43f6-ad91-7a29490c5992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:10.389256 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20859071-c665-43f6-ad91-7a29490c5992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:10.391790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20859071-c665-43f6-ad91-7a29490c5992 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:10.417623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 964/1914] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:39:10.418638 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933f49d-aa13-4311-92b4-a5ffc7343c08 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:10.432482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933f49d-aa13-4311-92b4-a5ffc7343c08 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:10.439458 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35ca14-40ca-4c5f-9d4e-1c54d28920ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:10.440325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35ca14-40ca-4c5f-9d4e-1c54d28920ce admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.440901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35ca14-40ca-4c5f-9d4e-1c54d28920ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.441167 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35ca14-40ca-4c5f-9d4e-1c54d28920ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.441945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35ca14-40ca-4c5f-9d4e-1c54d28920ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:10.444115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35ca14-40ca-4c5f-9d4e-1c54d28920ce admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:10.556639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 951/1915] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:10 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:10.557998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20859071-c665-43f6-ad91-7a29490c5992 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:10.568875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20859071-c665-43f6-ad91-7a29490c5992 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:10.633368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213fc0-9ed4-4188-8e28-bb594b5086ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:10.633368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213fc0-9ed4-4188-8e28-bb594b5086ce admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.633368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213fc0-9ed4-4188-8e28-bb594b5086ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.633368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213fc0-9ed4-4188-8e28-bb594b5086ce admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.633685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc213fc0-9ed4-4188-8e28-bb594b5086ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:10.635271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc213fc0-9ed4-4188-8e28-bb594b5086ce admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:10.655164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35ca14-40ca-4c5f-9d4e-1c54d28920ce admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:10.657538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cd35ca14-40ca-4c5f-9d4e-1c54d28920ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:10.681584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35ca14-40ca-4c5f-9d4e-1c54d28920ce admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:10.687403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:10.689304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.689677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.689899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] PATH_INFO: `/v3/projects/e0b47e1673b84e26accec1075c47140e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.691257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b47e1673b84e26accec1075c47140e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:10.693234 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:10.737217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 965/1916] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:10 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:10.741004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213fc0-9ed4-4188-8e28-bb594b5086ce admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:10.751059 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213fc0-9ed4-4188-8e28-bb594b5086ce admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:10.756203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30441449-5263-495f-93a1-7641ab763e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:10.756872 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30441449-5263-495f-93a1-7641ab763e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.757161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30441449-5263-495f-93a1-7641ab763e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.757498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30441449-5263-495f-93a1-7641ab763e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.758274 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30441449-5263-495f-93a1-7641ab763e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:10.759922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30441449-5263-495f-93a1-7641ab763e53 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:10.778451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 966/1917] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:39:10.779352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30441449-5263-495f-93a1-7641ab763e53 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:10.794758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30441449-5263-495f-93a1-7641ab763e53 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:10.823475 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b47e1673b84e26accec1075c47140e', 'request_id': 'req-8a57fcb9-673c-46e7-8141-ef0f1eac1263'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.830164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b47e1673b84e26accec1075c47140e', 'request_id': 'req-8a57fcb9-673c-46e7-8141-ef0f1eac1263'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.866005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9298297-37e6-49ae-9503-30786ecfd9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:10.866822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298297-37e6-49ae-9503-30786ecfd9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.867027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298297-37e6-49ae-9503-30786ecfd9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.867298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9298297-37e6-49ae-9503-30786ecfd9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.875305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9298297-37e6-49ae-9503-30786ecfd9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:10.875305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9298297-37e6-49ae-9503-30786ecfd9a2 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:10.880908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 967/1918] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:10.884911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9298297-37e6-49ae-9503-30786ecfd9a2 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:10.893260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b47e1673b84e26accec1075c47140e', 'request_id': 'req-8a57fcb9-673c-46e7-8141-ef0f1eac1263'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.894586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9298297-37e6-49ae-9503-30786ecfd9a2 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:10.899172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b58c5f-02d8-4a22-ac1d-4c048523bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:10.900044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58c5f-02d8-4a22-ac1d-4c048523bb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.900340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58c5f-02d8-4a22-ac1d-4c048523bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.900601 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58c5f-02d8-4a22-ac1d-4c048523bb7a admin admin] PATH_INFO: `/v3/projects/0e5ab909ba3a44d2a554f4d753db644a/users/2f1a7cfda0754eedbd0d9540fa76db38/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.913419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] The token cache is being invalidate because project e0b47e1673b84e26accec1075c47140e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:10.913419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.913419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a57fcb9-673c-46e7-8141-ef0f1eac1263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:10.913419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 952/1919] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:10 2022] DELETE /identity/v3/projects/e0b47e1673b84e26accec1075c47140e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:10.917931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b58c5f-02d8-4a22-ac1d-4c048523bb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5ab909ba3a44d2a554f4d753db644a, user_id=2f1a7cfda0754eedbd0d9540fa76db38, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:10.918155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979226fd-5eb4-40db-a059-35f4fb22ef09 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.918454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979226fd-5eb4-40db-a059-35f4fb22ef09 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.918733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979226fd-5eb4-40db-a059-35f4fb22ef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.920653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b58c5f-02d8-4a22-ac1d-4c048523bb7a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:10.939115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-979226fd-5eb4-40db-a059-35f4fb22ef09 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:10.940663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-979226fd-5eb4-40db-a059-35f4fb22ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:10.957852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 953/1920] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:10.965295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391001e-c73c-4cac-a609-31739a724bbd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:10.965588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391001e-c73c-4cac-a609-31739a724bbd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:10.965868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391001e-c73c-4cac-a609-31739a724bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:10.988724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f391001e-c73c-4cac-a609-31739a724bbd None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:10.990256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f391001e-c73c-4cac-a609-31739a724bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:11.000753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 954/1921] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:11.005188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391001e-c73c-4cac-a609-31739a724bbd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:11.008099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 968/1922] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:10 2022] PUT /identity/v3/projects/0e5ab909ba3a44d2a554f4d753db644a/users/2f1a7cfda0754eedbd0d9540fa76db38/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:39:11.017129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391001e-c73c-4cac-a609-31739a724bbd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:11.020992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8024b1c-cbe7-4401-87ee-3b8f0cf90293 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.021357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8024b1c-cbe7-4401-87ee-3b8f0cf90293 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.021669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8024b1c-cbe7-4401-87ee-3b8f0cf90293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.062254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-e8024b1c-cbe7-4401-87ee-3b8f0cf90293 None None] MFA Rules not processed for user `2f1a7cfda0754eedbd0d9540fa76db38`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:11.064443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e8024b1c-cbe7-4401-87ee-3b8f0cf90293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:11.080529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d14f7c-3430-43e2-8a5a-9b76529cd100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:11.081718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d14f7c-3430-43e2-8a5a-9b76529cd100 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.082136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d14f7c-3430-43e2-8a5a-9b76529cd100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.082491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d14f7c-3430-43e2-8a5a-9b76529cd100 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.083311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d14f7c-3430-43e2-8a5a-9b76529cd100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:11.083561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d14f7c-3430-43e2-8a5a-9b76529cd100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:11.085316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d14f7c-3430-43e2-8a5a-9b76529cd100 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:11.098890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 955/1923] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:39:11.103146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d14f7c-3430-43e2-8a5a-9b76529cd100 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:11.113825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d14f7c-3430-43e2-8a5a-9b76529cd100 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:11.121562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb24c7-2a87-4257-b715-419e354d2f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:11.122233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb24c7-2a87-4257-b715-419e354d2f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.122522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb24c7-2a87-4257-b715-419e354d2f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.122802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb24c7-2a87-4257-b715-419e354d2f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.123506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb24c7-2a87-4257-b715-419e354d2f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:11.126235 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb24c7-2a87-4257-b715-419e354d2f3c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:11.148052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 969/1924] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:11.154819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8024b1c-cbe7-4401-87ee-3b8f0cf90293 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:11.155844 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e8024b1c-cbe7-4401-87ee-3b8f0cf90293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:11.169376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8024b1c-cbe7-4401-87ee-3b8f0cf90293 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:11.176933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609dc7a-665a-4d4d-9c15-7a41f197f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:11.176933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609dc7a-665a-4d4d-9c15-7a41f197f097 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.176933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609dc7a-665a-4d4d-9c15-7a41f197f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.176933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609dc7a-665a-4d4d-9c15-7a41f197f097 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.177300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609dc7a-665a-4d4d-9c15-7a41f197f097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:11.178635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609dc7a-665a-4d4d-9c15-7a41f197f097 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:11.218644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 956/1925] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:11 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:11.220448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb24c7-2a87-4257-b715-419e354d2f3c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:11.283358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb24c7-2a87-4257-b715-419e354d2f3c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:11.289813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33c73-55da-4e66-94c1-9adabbf5ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:11.290043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 970/1926] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:11 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:11.293455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33c73-55da-4e66-94c1-9adabbf5ee32 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.293752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33c73-55da-4e66-94c1-9adabbf5ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.293869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609dc7a-665a-4d4d-9c15-7a41f197f097 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:11.295629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33c73-55da-4e66-94c1-9adabbf5ee32 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.295629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e33c73-55da-4e66-94c1-9adabbf5ee32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:11.296630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e33c73-55da-4e66-94c1-9adabbf5ee32 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:11.360070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609dc7a-665a-4d4d-9c15-7a41f197f097 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:11.365232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096290a9-5b6c-4e6a-b8ac-816aba24eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:11.366270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096290a9-5b6c-4e6a-b8ac-816aba24eae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.366637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096290a9-5b6c-4e6a-b8ac-816aba24eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.366989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096290a9-5b6c-4e6a-b8ac-816aba24eae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.368526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096290a9-5b6c-4e6a-b8ac-816aba24eae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:11.370944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096290a9-5b6c-4e6a-b8ac-816aba24eae8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:11.425060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 957/1927] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:11 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:11.427660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33c73-55da-4e66-94c1-9adabbf5ee32 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:11.427660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-02e33c73-55da-4e66-94c1-9adabbf5ee32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:11.440534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33c73-55da-4e66-94c1-9adabbf5ee32 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:11.445352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:11.446259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.446547 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.446827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] PATH_INFO: `/v3/users/0034ea4df67849d193d6fabca6395773` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.448057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0034ea4df67849d193d6fabca6395773)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:11.450001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:11.493916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 971/1928] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:11 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:11.495170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096290a9-5b6c-4e6a-b8ac-816aba24eae8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:11.496966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-096290a9-5b6c-4e6a-b8ac-816aba24eae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:11.510292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096290a9-5b6c-4e6a-b8ac-816aba24eae8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:11.515133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:11.516967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.517305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.517594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] PATH_INFO: `/v3/users/d9e64a3f17c347659eed5816eee2d383` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.525117 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e64a3f17c347659eed5816eee2d383)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:11.525117 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:11.679476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0034ea4df67849d193d6fabca6395773'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:11.697597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0034ea4df67849d193d6fabca6395773'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:11.705184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0034ea4df67849d193d6fabca6395773'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:11.756112 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e64a3f17c347659eed5816eee2d383'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:11.756300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0034ea4df67849d193d6fabca6395773'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:11.757161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e64a3f17c347659eed5816eee2d383'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:11.758209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e64a3f17c347659eed5816eee2d383'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:11.766552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0034ea4df67849d193d6fabca6395773'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:11.777614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e64a3f17c347659eed5816eee2d383'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:11.780491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 958/1929] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:11 2022] DELETE /identity/v3/users/0034ea4df67849d193d6fabca6395773 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:11.781714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:11.783479 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:11.786318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e64a3f17c347659eed5816eee2d383'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:11.855072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 972/1930] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:11 2022] DELETE /identity/v3/users/d9e64a3f17c347659eed5816eee2d383 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:11.857006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:11.860963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:11.878091 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44711-c2b5-4cab-9c40-97573630cf54 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:11.958401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c246c1-c084-4039-832f-db7cad545de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:11.959185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c246c1-c084-4039-832f-db7cad545de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.959539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c246c1-c084-4039-832f-db7cad545de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.960012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c246c1-c084-4039-832f-db7cad545de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.960767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c246c1-c084-4039-832f-db7cad545de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:11.961530 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01e4b-6111-4bca-99b9-3d4b381febbd admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:11.962447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c246c1-c084-4039-832f-db7cad545de1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:11.967031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f49a9-93b7-4787-b804-5ab7fa7a7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:11.967716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f49a9-93b7-4787-b804-5ab7fa7a7042 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.968004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f49a9-93b7-4787-b804-5ab7fa7a7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.968286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f49a9-93b7-4787-b804-5ab7fa7a7042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.969314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f49a9-93b7-4787-b804-5ab7fa7a7042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:11.971954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f49a9-93b7-4787-b804-5ab7fa7a7042 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:11.978265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 959/1931] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:11.979828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573b08-b725-44d7-83f2-eda2b63b3f75 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:11.980305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573b08-b725-44d7-83f2-eda2b63b3f75 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:11.980761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75573b08-b725-44d7-83f2-eda2b63b3f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:11.983819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 973/1932] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:11.985320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f49a9-93b7-4787-b804-5ab7fa7a7042 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:11.997702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f49a9-93b7-4787-b804-5ab7fa7a7042 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:12.003680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4ed8d-2197-4360-8773-714c0cbf8db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:12.004367 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4ed8d-2197-4360-8773-714c0cbf8db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.004644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-75573b08-b725-44d7-83f2-eda2b63b3f75 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:12.004785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4ed8d-2197-4360-8773-714c0cbf8db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.004923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4ed8d-2197-4360-8773-714c0cbf8db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.005703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4ed8d-2197-4360-8773-714c0cbf8db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:12.007029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-75573b08-b725-44d7-83f2-eda2b63b3f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.007445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4ed8d-2197-4360-8773-714c0cbf8db4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:12.016992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 960/1933] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:12.022812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75573b08-b725-44d7-83f2-eda2b63b3f75 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:12.022812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-75573b08-b725-44d7-83f2-eda2b63b3f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.023136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 974/1934] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:12.024665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4ed8d-2197-4360-8773-714c0cbf8db4 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:12.031233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75573b08-b725-44d7-83f2-eda2b63b3f75 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:12.035995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c46c2-1cc4-40a0-b664-50748ab459bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:12.036666 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c46c2-1cc4-40a0-b664-50748ab459bd admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.036959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c46c2-1cc4-40a0-b664-50748ab459bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.037240 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c46c2-1cc4-40a0-b664-50748ab459bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.037925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4ed8d-2197-4360-8773-714c0cbf8db4 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:12.038025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c46c2-1cc4-40a0-b664-50748ab459bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:12.039786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c46c2-1cc4-40a0-b664-50748ab459bd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:12.042751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce060f5-36e3-4e2d-a0fb-24ef4c1aabd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:12.043633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce060f5-36e3-4e2d-a0fb-24ef4c1aabd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.043926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce060f5-36e3-4e2d-a0fb-24ef4c1aabd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.044204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce060f5-36e3-4e2d-a0fb-24ef4c1aabd3 admin admin] PATH_INFO: `/v3/projects/f34c4289600d4a36a1b8920769f09037/users/f018c6dad204452f845e5be2bed7a54d/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.053502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 961/1935] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:12.053502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c46c2-1cc4-40a0-b664-50748ab459bd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:12.053502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5d2c46c2-1cc4-40a0-b664-50748ab459bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.059574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce060f5-36e3-4e2d-a0fb-24ef4c1aabd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34c4289600d4a36a1b8920769f09037, user_id=f018c6dad204452f845e5be2bed7a54d, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:12.062260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce060f5-36e3-4e2d-a0fb-24ef4c1aabd3 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:12.108860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c46c2-1cc4-40a0-b664-50748ab459bd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:12.113451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44246db-838d-4a82-94d8-d26689f30e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:12.114092 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44246db-838d-4a82-94d8-d26689f30e0c service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.114374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44246db-838d-4a82-94d8-d26689f30e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.114653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44246db-838d-4a82-94d8-d26689f30e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.123292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44246db-838d-4a82-94d8-d26689f30e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:12.124694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44246db-838d-4a82-94d8-d26689f30e0c service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:12.139367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 962/1936] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:12.140114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44246db-838d-4a82-94d8-d26689f30e0c service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:12.150061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44246db-838d-4a82-94d8-d26689f30e0c service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:12.155228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291abd55-69d9-4eff-b45e-285e1b0d7e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:12.156117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291abd55-69d9-4eff-b45e-285e1b0d7e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.156902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291abd55-69d9-4eff-b45e-285e1b0d7e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.157178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291abd55-69d9-4eff-b45e-285e1b0d7e16 admin admin] PATH_INFO: `/v3/projects/3385454d1eb84e7fa7ff611751870c26/users/a4b356e33e174224bb5363eca49e34d6/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.174137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291abd55-69d9-4eff-b45e-285e1b0d7e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3385454d1eb84e7fa7ff611751870c26, user_id=a4b356e33e174224bb5363eca49e34d6, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:12.176821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291abd55-69d9-4eff-b45e-285e1b0d7e16 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:12.203194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 975/1937] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:12 2022] PUT /identity/v3/projects/f34c4289600d4a36a1b8920769f09037/users/f018c6dad204452f845e5be2bed7a54d/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:12.204549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce060f5-36e3-4e2d-a0fb-24ef4c1aabd3 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:12.209006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6ce060f5-36e3-4e2d-a0fb-24ef4c1aabd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.277860 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce060f5-36e3-4e2d-a0fb-24ef4c1aabd3 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:12.283059 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:12.283931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.284230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.284497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] PATH_INFO: `/v3/users/243514f3745f4102a29bb2fb7820f4e8` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.285726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=243514f3745f4102a29bb2fb7820f4e8)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:12.287700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:12.293820 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 963/1938] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:12 2022] PUT /identity/v3/projects/3385454d1eb84e7fa7ff611751870c26/users/a4b356e33e174224bb5363eca49e34d6/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:12.294723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291abd55-69d9-4eff-b45e-285e1b0d7e16 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:12.297792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-291abd55-69d9-4eff-b45e-285e1b0d7e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.363921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291abd55-69d9-4eff-b45e-285e1b0d7e16 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:12.369167 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:12.369969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.370243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.370500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] PATH_INFO: `/v3/projects/1ca3db22ad6a4c14a5e86696a8cb43f9` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.371711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca3db22ad6a4c14a5e86696a8cb43f9)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:12.373650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:12.444004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '243514f3745f4102a29bb2fb7820f4e8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.444688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '243514f3745f4102a29bb2fb7820f4e8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.445331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '243514f3745f4102a29bb2fb7820f4e8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.458364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '243514f3745f4102a29bb2fb7820f4e8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.466234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8c8dabb1-0d79-4188-b2ed-2518d4b722a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '243514f3745f4102a29bb2fb7820f4e8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.474289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'request_id': 'req-e9eee6bd-9b41-4de1-9304-55894453fef7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.479752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'request_id': 'req-e9eee6bd-9b41-4de1-9304-55894453fef7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.527563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 976/1939] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:12 2022] DELETE /identity/v3/users/243514f3745f4102a29bb2fb7820f4e8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:12.528864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f34a-4a95-4b7b-a697-eb35406eea75 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.529188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f34a-4a95-4b7b-a697-eb35406eea75 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.529477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f34a-4a95-4b7b-a697-eb35406eea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.557404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5062f34a-4a95-4b7b-a697-eb35406eea75 None None] MFA Rules not processed for user `f018c6dad204452f845e5be2bed7a54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:12.558655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5062f34a-4a95-4b7b-a697-eb35406eea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.567716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'request_id': 'req-e9eee6bd-9b41-4de1-9304-55894453fef7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.580645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] The token cache is being invalidate because project 1ca3db22ad6a4c14a5e86696a8cb43f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:12.581070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.581798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e9eee6bd-9b41-4de1-9304-55894453fef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.587250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 964/1940] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:12 2022] DELETE /identity/v3/projects/1ca3db22ad6a4c14a5e86696a8cb43f9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:12.588880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87572dc2-2280-4207-9bd0-eb0ce6a24f88 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.589181 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87572dc2-2280-4207-9bd0-eb0ce6a24f88 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.589633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87572dc2-2280-4207-9bd0-eb0ce6a24f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.623708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-87572dc2-2280-4207-9bd0-eb0ce6a24f88 None None] MFA Rules not processed for user `a4b356e33e174224bb5363eca49e34d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:12.625045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-87572dc2-2280-4207-9bd0-eb0ce6a24f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.658005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 977/1941] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:12.658963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062f34a-4a95-4b7b-a697-eb35406eea75 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:12.660238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5062f34a-4a95-4b7b-a697-eb35406eea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.704525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 965/1942] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:12.706523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fee03-bf63-4c3e-b0b1-1b6bb5563f5a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.707039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fee03-bf63-4c3e-b0b1-1b6bb5563f5a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.707322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fee03-bf63-4c3e-b0b1-1b6bb5563f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.725710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7b9fee03-bf63-4c3e-b0b1-1b6bb5563f5a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:12.726928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7b9fee03-bf63-4c3e-b0b1-1b6bb5563f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.732825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062f34a-4a95-4b7b-a697-eb35406eea75 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:12.735787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 966/1943] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:12.736407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fee03-bf63-4c3e-b0b1-1b6bb5563f5a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:12.737653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7b9fee03-bf63-4c3e-b0b1-1b6bb5563f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.739337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:12.740388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.740865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.741312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] PATH_INFO: `/v3/projects/1f9490fdc2dd468d87ee3369af51f339` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.743101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9490fdc2dd468d87ee3369af51f339)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:12.745004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:12.749205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fee03-bf63-4c3e-b0b1-1b6bb5563f5a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:12.756054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cdf4c-2b22-4a46-9e63-296563eca9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:12.756714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cdf4c-2b22-4a46-9e63-296563eca9ae admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.757001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cdf4c-2b22-4a46-9e63-296563eca9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.757333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cdf4c-2b22-4a46-9e63-296563eca9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.758043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cdf4c-2b22-4a46-9e63-296563eca9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:12.759929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cdf4c-2b22-4a46-9e63-296563eca9ae admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:12.868889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 967/1944] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:12 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:12.868889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cdf4c-2b22-4a46-9e63-296563eca9ae admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:12.872134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-068cdf4c-2b22-4a46-9e63-296563eca9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:12.878900 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9490fdc2dd468d87ee3369af51f339', 'request_id': 'req-70093ecc-1615-4f4f-86af-3d4c7ee81da3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.887985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9490fdc2dd468d87ee3369af51f339', 'request_id': 'req-70093ecc-1615-4f4f-86af-3d4c7ee81da3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.938417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cdf4c-2b22-4a46-9e63-296563eca9ae admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:12.943132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84272604-3eee-4dc6-99eb-898ce5f47afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:12.943792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84272604-3eee-4dc6-99eb-898ce5f47afd admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.944076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84272604-3eee-4dc6-99eb-898ce5f47afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.944354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84272604-3eee-4dc6-99eb-898ce5f47afd admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:12.945054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84272604-3eee-4dc6-99eb-898ce5f47afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:12.946989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84272604-3eee-4dc6-99eb-898ce5f47afd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:12.981086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9490fdc2dd468d87ee3369af51f339', 'request_id': 'req-70093ecc-1615-4f4f-86af-3d4c7ee81da3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.989510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] The token cache is being invalidate because project 1f9490fdc2dd468d87ee3369af51f339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:12.989803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.990477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-70093ecc-1615-4f4f-86af-3d4c7ee81da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:12.992123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 978/1945] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:12 2022] DELETE /identity/v3/projects/1f9490fdc2dd468d87ee3369af51f339 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:12.994139 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c229d1-3716-42ca-86ca-74a3ea28b02a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:12.994139 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c229d1-3716-42ca-86ca-74a3ea28b02a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:12.994139 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c229d1-3716-42ca-86ca-74a3ea28b02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:13.014440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-61c229d1-3716-42ca-86ca-74a3ea28b02a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:13.016260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-61c229d1-3716-42ca-86ca-74a3ea28b02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.024917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 979/1946] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:13.025580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c229d1-3716-42ca-86ca-74a3ea28b02a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.026819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-61c229d1-3716-42ca-86ca-74a3ea28b02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.038956 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c229d1-3716-42ca-86ca-74a3ea28b02a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.043737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:13.044594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:13.050248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:13.050248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] PATH_INFO: `/v3/projects/bb824bf2b6dd48ca9b9e9fa7767dd67d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:13.050447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 968/1947] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:12 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:13.050858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb824bf2b6dd48ca9b9e9fa7767dd67d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:13.050932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84272604-3eee-4dc6-99eb-898ce5f47afd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.051000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:13.051078 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-84272604-3eee-4dc6-99eb-898ce5f47afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.117649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84272604-3eee-4dc6-99eb-898ce5f47afd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.122434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb37e5d-8900-4d45-ac1d-635b4413cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:13.123102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb37e5d-8900-4d45-ac1d-635b4413cc2e admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:13.123392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb37e5d-8900-4d45-ac1d-635b4413cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:13.123676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb37e5d-8900-4d45-ac1d-635b4413cc2e admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:13.124372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb37e5d-8900-4d45-ac1d-635b4413cc2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:13.126867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb37e5d-8900-4d45-ac1d-635b4413cc2e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:13.166343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb824bf2b6dd48ca9b9e9fa7767dd67d', 'request_id': 'req-2630f6a3-ffed-4495-8139-dafe1934b38c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.171538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb824bf2b6dd48ca9b9e9fa7767dd67d', 'request_id': 'req-2630f6a3-ffed-4495-8139-dafe1934b38c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.202276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 969/1948] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:13 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:13.202952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb37e5d-8900-4d45-ac1d-635b4413cc2e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.205425 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7bb37e5d-8900-4d45-ac1d-635b4413cc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.217113 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb37e5d-8900-4d45-ac1d-635b4413cc2e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.246656 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb824bf2b6dd48ca9b9e9fa7767dd67d', 'request_id': 'req-2630f6a3-ffed-4495-8139-dafe1934b38c'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.263604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] The token cache is being invalidate because project bb824bf2b6dd48ca9b9e9fa7767dd67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:13.263923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.264681 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.266761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 980/1949] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:13 2022] DELETE /identity/v3/projects/bb824bf2b6dd48ca9b9e9fa7767dd67d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:13.267772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.269939 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.279650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:13.280997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:13.281540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:13.281979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] PATH_INFO: `/v3/users/39ea2326c02040e1811aacaad93a01f9` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:13.283834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ea2326c02040e1811aacaad93a01f9)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:13.287031 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:13.345685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f6a3-ffed-4495-8139-dafe1934b38c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.350441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0170-e824-432d-a237-5e8996b5150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:13.351104 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0170-e824-432d-a237-5e8996b5150f admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:13.351526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0170-e824-432d-a237-5e8996b5150f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:13.351806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0170-e824-432d-a237-5e8996b5150f admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:13.352631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0170-e824-432d-a237-5e8996b5150f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:13.352945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0170-e824-432d-a237-5e8996b5150f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:13.354563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0170-e824-432d-a237-5e8996b5150f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:13.366990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 981/1950] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:39:13.367912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0170-e824-432d-a237-5e8996b5150f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.369533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bcdb0170-e824-432d-a237-5e8996b5150f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.383873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0170-e824-432d-a237-5e8996b5150f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.388467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347f1fc-c677-42a4-bddc-415bab5cb5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:13.391426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347f1fc-c677-42a4-bddc-415bab5cb5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:13.391426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347f1fc-c677-42a4-bddc-415bab5cb5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:13.391426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347f1fc-c677-42a4-bddc-415bab5cb5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:13.391426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347f1fc-c677-42a4-bddc-415bab5cb5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:13.392770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347f1fc-c677-42a4-bddc-415bab5cb5c4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:13.474349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ea2326c02040e1811aacaad93a01f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.487981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ea2326c02040e1811aacaad93a01f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.488919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ea2326c02040e1811aacaad93a01f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.489377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 982/1951] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:13 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:13.490218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347f1fc-c677-42a4-bddc-415bab5cb5c4 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.494755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3347f1fc-c677-42a4-bddc-415bab5cb5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.506042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347f1fc-c677-42a4-bddc-415bab5cb5c4 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.510817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484d263-f13d-4cec-a931-429088a00363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:13.511491 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d263-f13d-4cec-a931-429088a00363 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:13.511774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d263-f13d-4cec-a931-429088a00363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:13.512055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484d263-f13d-4cec-a931-429088a00363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:13.512782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484d263-f13d-4cec-a931-429088a00363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:13.514665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484d263-f13d-4cec-a931-429088a00363 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:13.527742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 983/1952] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:13.528587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484d263-f13d-4cec-a931-429088a00363 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.530296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5484d263-f13d-4cec-a931-429088a00363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.546148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484d263-f13d-4cec-a931-429088a00363 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.554035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:13.554918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:13.555354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:13.555505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] PATH_INFO: `/v3/users/9690317aef1740c79bdb1553ce33fc8a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:13.556744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9690317aef1740c79bdb1553ce33fc8a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:13.558974 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:13.572447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ea2326c02040e1811aacaad93a01f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.581320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ea2326c02040e1811aacaad93a01f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.588153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 970/1953] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:13 2022] DELETE /identity/v3/users/39ea2326c02040e1811aacaad93a01f9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:13.589169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.590556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.672963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cd9f0-43f4-49b6-9066-d10125c23204 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.678195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ae212-f32d-4e92-b3e2-85f8ff6e4c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:13.678987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ae212-f32d-4e92-b3e2-85f8ff6e4c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:13.679274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ae212-f32d-4e92-b3e2-85f8ff6e4c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:13.679554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ae212-f32d-4e92-b3e2-85f8ff6e4c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:13.680333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ae212-f32d-4e92-b3e2-85f8ff6e4c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:13.682487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ae212-f32d-4e92-b3e2-85f8ff6e4c4d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:13.777382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9690317aef1740c79bdb1553ce33fc8a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.778068 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9690317aef1740c79bdb1553ce33fc8a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.778702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9690317aef1740c79bdb1553ce33fc8a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.791547 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9690317aef1740c79bdb1553ce33fc8a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.801337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 971/1954] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:13 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:13.802026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9690317aef1740c79bdb1553ce33fc8a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:13.805569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ae212-f32d-4e92-b3e2-85f8ff6e4c4d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.807832 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d71ae212-f32d-4e92-b3e2-85f8ff6e4c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.888344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ae212-f32d-4e92-b3e2-85f8ff6e4c4d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.893055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 984/1955] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:13 2022] DELETE /identity/v3/users/9690317aef1740c79bdb1553ce33fc8a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:13.894092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.897713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.901920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978be8b8-379c-438a-93ee-971748f28cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:13.902875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be8b8-379c-438a-93ee-971748f28cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:13.903233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be8b8-379c-438a-93ee-971748f28cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:13.903585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be8b8-379c-438a-93ee-971748f28cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:13.904622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978be8b8-379c-438a-93ee-971748f28cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:13.907674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978be8b8-379c-438a-93ee-971748f28cb0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:13.922550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 972/1956] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:13.922984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978be8b8-379c-438a-93ee-971748f28cb0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:13.930711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-978be8b8-379c-438a-93ee-971748f28cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:13.945020 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978be8b8-379c-438a-93ee-971748f28cb0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.976646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5542d2-2fc7-4332-8db1-d382cfbd3bae admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:13.982872 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800a760-2274-4f33-a4fb-3ac6d42df798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:13.983796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a760-2274-4f33-a4fb-3ac6d42df798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:13.984087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a760-2274-4f33-a4fb-3ac6d42df798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:13.984470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a760-2274-4f33-a4fb-3ac6d42df798 admin admin] PATH_INFO: `/v3/projects/8f3f132c277e4acabf1b127ee2fbfdfb/users/0a2caa29a3f84770b60eedd56fd7d4a5/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.002974 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800a760-2274-4f33-a4fb-3ac6d42df798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3f132c277e4acabf1b127ee2fbfdfb, user_id=0a2caa29a3f84770b60eedd56fd7d4a5, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.006135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800a760-2274-4f33-a4fb-3ac6d42df798 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.019994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a84f3-c3cc-4037-bc79-51d0f8de2a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.020928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a84f3-c3cc-4037-bc79-51d0f8de2a71 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.021224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a84f3-c3cc-4037-bc79-51d0f8de2a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.021589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a84f3-c3cc-4037-bc79-51d0f8de2a71 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.022306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a84f3-c3cc-4037-bc79-51d0f8de2a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.024249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a84f3-c3cc-4037-bc79-51d0f8de2a71 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.106462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 985/1957] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:13 2022] PUT /identity/v3/projects/8f3f132c277e4acabf1b127ee2fbfdfb/users/0a2caa29a3f84770b60eedd56fd7d4a5/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:14.107339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800a760-2274-4f33-a4fb-3ac6d42df798 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:14.137498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 973/1958] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:13 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:14.143849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a84f3-c3cc-4037-bc79-51d0f8de2a71 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:14.177929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a84f3-c3cc-4037-bc79-51d0f8de2a71 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:14.240868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800a760-2274-4f33-a4fb-3ac6d42df798 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:14.248273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c0c7-9c16-47f5-965a-ee0b09cd1b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.249196 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c0c7-9c16-47f5-965a-ee0b09cd1b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.250123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c0c7-9c16-47f5-965a-ee0b09cd1b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.250123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c0c7-9c16-47f5-965a-ee0b09cd1b45 admin admin] PATH_INFO: `/v3/projects/98b68dde47d44766a958a2a4e739f792/users/412c817c51c643ad8015b4138d206b03/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.280352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8c0c7-9c16-47f5-965a-ee0b09cd1b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b68dde47d44766a958a2a4e739f792, user_id=412c817c51c643ad8015b4138d206b03, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.285171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba5e96-2a68-4471-b30c-a9fc1485b391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.285171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba5e96-2a68-4471-b30c-a9fc1485b391 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.285171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba5e96-2a68-4471-b30c-a9fc1485b391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.285171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba5e96-2a68-4471-b30c-a9fc1485b391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.285802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba5e96-2a68-4471-b30c-a9fc1485b391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.285955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8c0c7-9c16-47f5-965a-ee0b09cd1b45 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.287000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba5e96-2a68-4471-b30c-a9fc1485b391 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.298168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 974/1959] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:14.299190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba5e96-2a68-4471-b30c-a9fc1485b391 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:14.313638 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba5e96-2a68-4471-b30c-a9fc1485b391 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:14.314589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c5b6-4cce-4f62-894b-20b12ef7f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.315321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c5b6-4cce-4f62-894b-20b12ef7f525 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.315692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c5b6-4cce-4f62-894b-20b12ef7f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.315976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c5b6-4cce-4f62-894b-20b12ef7f525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.316702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c5b6-4cce-4f62-894b-20b12ef7f525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.318302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c5b6-4cce-4f62-894b-20b12ef7f525 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.328768 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 975/1960] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:14.329612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c5b6-4cce-4f62-894b-20b12ef7f525 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:14.331260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-78b0c5b6-4cce-4f62-894b-20b12ef7f525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:14.343299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c5b6-4cce-4f62-894b-20b12ef7f525 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:14.348653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.349530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.349816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.350094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] PATH_INFO: `/v3/projects/25b68bc9254342068fef54877dfba966` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.351268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b68bc9254342068fef54877dfba966)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.353175 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.385577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 986/1961] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:14 2022] PUT /identity/v3/projects/98b68dde47d44766a958a2a4e739f792/users/412c817c51c643ad8015b4138d206b03/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:14.386549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c0c7-9c16-47f5-965a-ee0b09cd1b45 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:14.388116 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e6a8c0c7-9c16-47f5-965a-ee0b09cd1b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:14.449660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c0c7-9c16-47f5-965a-ee0b09cd1b45 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:14.454999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.455858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.456145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.456425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] PATH_INFO: `/v3/projects/7a642b9a32264ec7bc99453ed33ad4ff` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.457788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a642b9a32264ec7bc99453ed33ad4ff)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.459693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.471473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b68bc9254342068fef54877dfba966', 'request_id': 'req-01abe5bd-9bad-4efd-96ee-d4e8b931989c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:14.476998 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b68bc9254342068fef54877dfba966', 'request_id': 'req-01abe5bd-9bad-4efd-96ee-d4e8b931989c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:14.556485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b68bc9254342068fef54877dfba966', 'request_id': 'req-01abe5bd-9bad-4efd-96ee-d4e8b931989c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:14.568940 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] The token cache is being invalidate because project 25b68bc9254342068fef54877dfba966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:14.569160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:14.569816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:14.571358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 976/1962] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:14 2022] DELETE /identity/v3/projects/25b68bc9254342068fef54877dfba966 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:14.572118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:14.573403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:14.603534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a642b9a32264ec7bc99453ed33ad4ff', 'request_id': 'req-34970e5a-f382-4b49-a7d2-51c3678b6a9a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:14.608879 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a642b9a32264ec7bc99453ed33ad4ff', 'request_id': 'req-34970e5a-f382-4b49-a7d2-51c3678b6a9a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:14.636672 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abe5bd-9bad-4efd-96ee-d4e8b931989c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:14.670375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a642b9a32264ec7bc99453ed33ad4ff', 'request_id': 'req-34970e5a-f382-4b49-a7d2-51c3678b6a9a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:14.682142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] The token cache is being invalidate because project 7a642b9a32264ec7bc99453ed33ad4ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:14.682438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:14.683164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:14.684747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 987/1963] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:14 2022] DELETE /identity/v3/projects/7a642b9a32264ec7bc99453ed33ad4ff => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:14.685692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:14.686996 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:14.693737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5d760-bd5d-4925-8c78-ca8d4f7da626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.694679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5d760-bd5d-4925-8c78-ca8d4f7da626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.694959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5d760-bd5d-4925-8c78-ca8d4f7da626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.695270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5d760-bd5d-4925-8c78-ca8d4f7da626 admin admin] PATH_INFO: `/v3/projects/8f3f132c277e4acabf1b127ee2fbfdfb/users/0a2caa29a3f84770b60eedd56fd7d4a5/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.697307 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5d760-bd5d-4925-8c78-ca8d4f7da626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3f132c277e4acabf1b127ee2fbfdfb, user_id=0a2caa29a3f84770b60eedd56fd7d4a5, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.699935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5d760-bd5d-4925-8c78-ca8d4f7da626 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.701142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34970e5a-f382-4b49-a7d2-51c3678b6a9a admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:14.706657 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfff68-d795-4228-8c55-134a1d52e335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.707358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfff68-d795-4228-8c55-134a1d52e335 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.707651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfff68-d795-4228-8c55-134a1d52e335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.707934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfff68-d795-4228-8c55-134a1d52e335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.715622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfff68-d795-4228-8c55-134a1d52e335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.715622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfff68-d795-4228-8c55-134a1d52e335 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.715797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 977/1964] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:14 2022] PUT /identity/v3/projects/8f3f132c277e4acabf1b127ee2fbfdfb/users/0a2caa29a3f84770b60eedd56fd7d4a5/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:14.715797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5d760-bd5d-4925-8c78-ca8d4f7da626 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:14.715797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-84a5d760-bd5d-4925-8c78-ca8d4f7da626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:14.724330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 988/1965] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:14.724330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caa510-a754-4ac9-a83e-c08cf0eafc12 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.724330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caa510-a754-4ac9-a83e-c08cf0eafc12 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.724330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caa510-a754-4ac9-a83e-c08cf0eafc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.741862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-78caa510-a754-4ac9-a83e-c08cf0eafc12 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:14.743060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-78caa510-a754-4ac9-a83e-c08cf0eafc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:14.777588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5d760-bd5d-4925-8c78-ca8d4f7da626 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:14.782274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87560622-eb78-41b7-875b-8467124cd20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.782945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87560622-eb78-41b7-875b-8467124cd20a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.783242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87560622-eb78-41b7-875b-8467124cd20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.783522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87560622-eb78-41b7-875b-8467124cd20a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.784253 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87560622-eb78-41b7-875b-8467124cd20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.786891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87560622-eb78-41b7-875b-8467124cd20a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.798435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 978/1966] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:14.799824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65483052-d58f-4d2c-a954-a94b08554fbb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.800111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65483052-d58f-4d2c-a954-a94b08554fbb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.800386 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65483052-d58f-4d2c-a954-a94b08554fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.803734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 989/1967] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:14.804642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caa510-a754-4ac9-a83e-c08cf0eafc12 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:14.814766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caa510-a754-4ac9-a83e-c08cf0eafc12 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:14.821083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5ad5-db5a-44d5-985c-08704fbf223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.821214 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-65483052-d58f-4d2c-a954-a94b08554fbb None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:14.821342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5ad5-db5a-44d5-985c-08704fbf223e admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.821342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5ad5-db5a-44d5-985c-08704fbf223e admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.821496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-65483052-d58f-4d2c-a954-a94b08554fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:14.821597 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5ad5-db5a-44d5-985c-08704fbf223e admin admin] PATH_INFO: `/v3/projects/726b268af80347bbbf58e80cef5c61bc/users/e3fa08cd466c419e80198a5b44b719f9/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.829061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 979/1968] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:14.830342 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e293495-d713-4d5c-beb9-4dd7418b4048 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.830942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e293495-d713-4d5c-beb9-4dd7418b4048 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.830942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e293495-d713-4d5c-beb9-4dd7418b4048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.837616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5ad5-db5a-44d5-985c-08704fbf223e admin admin] RBAC: Authorizing `identity:create_grant(project_id=726b268af80347bbbf58e80cef5c61bc, user_id=e3fa08cd466c419e80198a5b44b719f9, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.840297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5ad5-db5a-44d5-985c-08704fbf223e admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:14.860220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8e293495-d713-4d5c-beb9-4dd7418b4048 None None] MFA Rules not processed for user `0a2caa29a3f84770b60eedd56fd7d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:14.861479 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8e293495-d713-4d5c-beb9-4dd7418b4048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:14.897874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 990/1969] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:14 2022] PUT /identity/v3/projects/726b268af80347bbbf58e80cef5c61bc/users/e3fa08cd466c419e80198a5b44b719f9/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:14.898687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5ad5-db5a-44d5-985c-08704fbf223e admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:14.933768 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 980/1970] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:14.935076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7338a3-fecd-43cc-9281-e250bc548c2b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.935375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7338a3-fecd-43cc-9281-e250bc548c2b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.935658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7338a3-fecd-43cc-9281-e250bc548c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.955314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4e7338a3-fecd-43cc-9281-e250bc548c2b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:14.956503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4e7338a3-fecd-43cc-9281-e250bc548c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:14.970733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5ad5-db5a-44d5-985c-08704fbf223e admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:14.975789 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfda403-ea26-4419-873a-c14fa60782d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:14.976730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda403-ea26-4419-873a-c14fa60782d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:14.977015 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda403-ea26-4419-873a-c14fa60782d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:14.977322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda403-ea26-4419-873a-c14fa60782d5 admin admin] PATH_INFO: `/v3/projects/98b68dde47d44766a958a2a4e739f792/users/412c817c51c643ad8015b4138d206b03/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:14.979293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfda403-ea26-4419-873a-c14fa60782d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b68dde47d44766a958a2a4e739f792, user_id=412c817c51c643ad8015b4138d206b03, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:14.981977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfda403-ea26-4419-873a-c14fa60782d5 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.002910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 991/1971] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:14 2022] PUT /identity/v3/projects/98b68dde47d44766a958a2a4e739f792/users/412c817c51c643ad8015b4138d206b03/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:15.002910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731775ee-1896-4275-a3d2-28211fafc0c4 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.002910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731775ee-1896-4275-a3d2-28211fafc0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.002910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731775ee-1896-4275-a3d2-28211fafc0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.014973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 981/1972] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:15.016433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9918de-a1ab-4213-8968-6a2e7f0804b9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.016579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-731775ee-1896-4275-a3d2-28211fafc0c4 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:15.016726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9918de-a1ab-4213-8968-6a2e7f0804b9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.017006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9918de-a1ab-4213-8968-6a2e7f0804b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.018303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-731775ee-1896-4275-a3d2-28211fafc0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:15.033979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3f9918de-a1ab-4213-8968-6a2e7f0804b9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:15.035152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3f9918de-a1ab-4213-8968-6a2e7f0804b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:15.077033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 992/1973] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:15.077833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731775ee-1896-4275-a3d2-28211fafc0c4 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.081803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-731775ee-1896-4275-a3d2-28211fafc0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:15.092301 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 982/1974] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:15.094130 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883065f-23f2-410a-8463-f37d6d8031cf None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.094454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883065f-23f2-410a-8463-f37d6d8031cf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.094743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883065f-23f2-410a-8463-f37d6d8031cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.121461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8883065f-23f2-410a-8463-f37d6d8031cf None None] MFA Rules not processed for user `412c817c51c643ad8015b4138d206b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:15.122668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8883065f-23f2-410a-8463-f37d6d8031cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:15.138798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731775ee-1896-4275-a3d2-28211fafc0c4 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.143092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7a841-cc5c-43f9-aa07-f1c07339fa13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.143742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a841-cc5c-43f9-aa07-f1c07339fa13 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.144026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a841-cc5c-43f9-aa07-f1c07339fa13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.144304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a841-cc5c-43f9-aa07-f1c07339fa13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.189178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 983/1975] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:15.190176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883065f-23f2-410a-8463-f37d6d8031cf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.201625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883065f-23f2-410a-8463-f37d6d8031cf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.204788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7a841-cc5c-43f9-aa07-f1c07339fa13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.206305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7a841-cc5c-43f9-aa07-f1c07339fa13 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.206425 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23725d-bc7f-432c-bb00-e398a5bd3593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.207030 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23725d-bc7f-432c-bb00-e398a5bd3593 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.207314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23725d-bc7f-432c-bb00-e398a5bd3593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.207593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23725d-bc7f-432c-bb00-e398a5bd3593 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.208328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23725d-bc7f-432c-bb00-e398a5bd3593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:15.208730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23725d-bc7f-432c-bb00-e398a5bd3593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.210472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23725d-bc7f-432c-bb00-e398a5bd3593 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.216528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 993/1976] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:15.217584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7a841-cc5c-43f9-aa07-f1c07339fa13 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.223486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 984/1977] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:39:15.224319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23725d-bc7f-432c-bb00-e398a5bd3593 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.226004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-df23725d-bc7f-432c-bb00-e398a5bd3593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:15.233520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7a841-cc5c-43f9-aa07-f1c07339fa13 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.239398 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d8f5-0553-4496-b7c5-8c22da562020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.240070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d8f5-0553-4496-b7c5-8c22da562020 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.240377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d8f5-0553-4496-b7c5-8c22da562020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.240639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d8f5-0553-4496-b7c5-8c22da562020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.241417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1d8f5-0553-4496-b7c5-8c22da562020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:15.241719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1d8f5-0553-4496-b7c5-8c22da562020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.243315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1d8f5-0553-4496-b7c5-8c22da562020 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.255331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 994/1978] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:39:15.256142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d8f5-0553-4496-b7c5-8c22da562020 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.257848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-78c1d8f5-0553-4496-b7c5-8c22da562020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:15.269968 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d8f5-0553-4496-b7c5-8c22da562020 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.273674 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a57d3-64d0-4db9-aeff-4301ed58d4dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.274371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a57d3-64d0-4db9-aeff-4301ed58d4dc service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.274746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a57d3-64d0-4db9-aeff-4301ed58d4dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.275030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a57d3-64d0-4db9-aeff-4301ed58d4dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.276805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-293a57d3-64d0-4db9-aeff-4301ed58d4dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:15.295577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23725d-bc7f-432c-bb00-e398a5bd3593 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.300332 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b089389-3cff-4915-b437-1828af747fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.300845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b089389-3cff-4915-b437-1828af747fee service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.301152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b089389-3cff-4915-b437-1828af747fee service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.301481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b089389-3cff-4915-b437-1828af747fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.310613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b089389-3cff-4915-b437-1828af747fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.312047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b089389-3cff-4915-b437-1828af747fee service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.322047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 985/1979] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:15.322906 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b089389-3cff-4915-b437-1828af747fee service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.332635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b089389-3cff-4915-b437-1828af747fee service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.338242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63230d2-7c9c-4448-811f-9fd3239e5d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.338900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63230d2-7c9c-4448-811f-9fd3239e5d32 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.339184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63230d2-7c9c-4448-811f-9fd3239e5d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.340118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63230d2-7c9c-4448-811f-9fd3239e5d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.340302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63230d2-7c9c-4448-811f-9fd3239e5d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.340580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a57d3-64d0-4db9-aeff-4301ed58d4dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.342223 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63230d2-7c9c-4448-811f-9fd3239e5d32 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.344344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a57d3-64d0-4db9-aeff-4301ed58d4dc service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.359267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 995/1980] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:15.361426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a57d3-64d0-4db9-aeff-4301ed58d4dc service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.376154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a57d3-64d0-4db9-aeff-4301ed58d4dc service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.384355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588ee8-b062-4691-bc1f-5ff864313da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.385013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588ee8-b062-4691-bc1f-5ff864313da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.385317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588ee8-b062-4691-bc1f-5ff864313da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.385599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588ee8-b062-4691-bc1f-5ff864313da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.386288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49588ee8-b062-4691-bc1f-5ff864313da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.388244 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49588ee8-b062-4691-bc1f-5ff864313da7 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.436297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 986/1981] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:15 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:15.437408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63230d2-7c9c-4448-811f-9fd3239e5d32 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.495531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 996/1982] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:15 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:15.500004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588ee8-b062-4691-bc1f-5ff864313da7 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.549140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63230d2-7c9c-4448-811f-9fd3239e5d32 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.615595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588ee8-b062-4691-bc1f-5ff864313da7 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.631280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2c30d-b0b4-4f23-a942-7f67b38b9594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.631794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2c30d-b0b4-4f23-a942-7f67b38b9594 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.632077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2c30d-b0b4-4f23-a942-7f67b38b9594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.632690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2c30d-b0b4-4f23-a942-7f67b38b9594 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.634580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2c30d-b0b4-4f23-a942-7f67b38b9594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.638757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2c30d-b0b4-4f23-a942-7f67b38b9594 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.659111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6151980-77f8-49eb-ace2-467836383eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.665168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6151980-77f8-49eb-ace2-467836383eca admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.666002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6151980-77f8-49eb-ace2-467836383eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.666445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6151980-77f8-49eb-ace2-467836383eca admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.667705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6151980-77f8-49eb-ace2-467836383eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.670485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6151980-77f8-49eb-ace2-467836383eca admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.748409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 997/1983] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:15 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:15.752943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2c30d-b0b4-4f23-a942-7f67b38b9594 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.763802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2c30d-b0b4-4f23-a942-7f67b38b9594 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.770212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 987/1984] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:15 2022] POST /identity/v3/users => generated 287 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:15.773877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6151980-77f8-49eb-ace2-467836383eca admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.774345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32568440-f41b-48c7-bef2-8254864abf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.775088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32568440-f41b-48c7-bef2-8254864abf72 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.775378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32568440-f41b-48c7-bef2-8254864abf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.775833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32568440-f41b-48c7-bef2-8254864abf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.777669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32568440-f41b-48c7-bef2-8254864abf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.779898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32568440-f41b-48c7-bef2-8254864abf72 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.797057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6151980-77f8-49eb-ace2-467836383eca admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.802801 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 998/1985] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:15.803981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a269-f598-4347-96f5-7d9f56ea8049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.804300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a269-f598-4347-96f5-7d9f56ea8049 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.804583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a269-f598-4347-96f5-7d9f56ea8049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.804862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585a269-f598-4347-96f5-7d9f56ea8049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.805199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32568440-f41b-48c7-bef2-8254864abf72 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.805733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585a269-f598-4347-96f5-7d9f56ea8049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.807330 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585a269-f598-4347-96f5-7d9f56ea8049 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.818673 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32568440-f41b-48c7-bef2-8254864abf72 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.826127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074d13b-ef47-45c8-a6ee-18ce6a3728ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.827207 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074d13b-ef47-45c8-a6ee-18ce6a3728ea admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.827593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074d13b-ef47-45c8-a6ee-18ce6a3728ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.828826 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074d13b-ef47-45c8-a6ee-18ce6a3728ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.828948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 988/1986] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:39:15.831992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074d13b-ef47-45c8-a6ee-18ce6a3728ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.832984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a269-f598-4347-96f5-7d9f56ea8049 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.834007 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074d13b-ef47-45c8-a6ee-18ce6a3728ea admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.843428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585a269-f598-4347-96f5-7d9f56ea8049 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.846932 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 999/1987] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:15.851162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074d13b-ef47-45c8-a6ee-18ce6a3728ea admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.851882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf2590-d46f-4f5d-a28b-f4cd3e0f3e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.852707 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf2590-d46f-4f5d-a28b-f4cd3e0f3e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.853186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf2590-d46f-4f5d-a28b-f4cd3e0f3e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.853529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf2590-d46f-4f5d-a28b-f4cd3e0f3e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.854257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf2590-d46f-4f5d-a28b-f4cd3e0f3e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.855844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf2590-d46f-4f5d-a28b-f4cd3e0f3e3b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.862338 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074d13b-ef47-45c8-a6ee-18ce6a3728ea admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.867297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a1021-6593-4a73-a285-d5631a3ff888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.868332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a1021-6593-4a73-a285-d5631a3ff888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.868691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a1021-6593-4a73-a285-d5631a3ff888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.869662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a1021-6593-4a73-a285-d5631a3ff888 admin admin] PATH_INFO: `/v3/projects/43069e4b5d394dc4a733cf11628eac72/users/eb3a1cc28fbe48b18d0fd19415cd7a53/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.870091 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 989/1988] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:15.872581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf2590-d46f-4f5d-a28b-f4cd3e0f3e3b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.883631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf2590-d46f-4f5d-a28b-f4cd3e0f3e3b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:15.888882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f47b-be71-473a-9fd1-92d0898c7bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:15.889937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f47b-be71-473a-9fd1-92d0898c7bba admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:15.890296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f47b-be71-473a-9fd1-92d0898c7bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:15.891217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f47b-be71-473a-9fd1-92d0898c7bba admin admin] PATH_INFO: `/v3/projects/2173eca79ba24a31b45892d8d8a29159/users/6d1cdf36ab1a42ba9516fb3b3ec22e4e/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:15.892925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a1021-6593-4a73-a285-d5631a3ff888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43069e4b5d394dc4a733cf11628eac72, user_id=eb3a1cc28fbe48b18d0fd19415cd7a53, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.895966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a1021-6593-4a73-a285-d5631a3ff888 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.908063 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8f47b-be71-473a-9fd1-92d0898c7bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2173eca79ba24a31b45892d8d8a29159, user_id=6d1cdf36ab1a42ba9516fb3b3ec22e4e, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:15.910738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8f47b-be71-473a-9fd1-92d0898c7bba admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:15.958493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1000/1989] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:15 2022] PUT /identity/v3/projects/43069e4b5d394dc4a733cf11628eac72/users/eb3a1cc28fbe48b18d0fd19415cd7a53/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:39:15.959540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a1021-6593-4a73-a285-d5631a3ff888 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:15.964510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c52a1021-6593-4a73-a285-d5631a3ff888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:16.006441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 990/1990] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:15 2022] PUT /identity/v3/projects/2173eca79ba24a31b45892d8d8a29159/users/6d1cdf36ab1a42ba9516fb3b3ec22e4e/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:16.009076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b588d-ac3f-47d2-bf2a-d5bf3691d033 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:16.009733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b588d-ac3f-47d2-bf2a-d5bf3691d033 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:16.010785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b588d-ac3f-47d2-bf2a-d5bf3691d033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:16.034191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-aa8b588d-ac3f-47d2-bf2a-d5bf3691d033 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:16.040145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-aa8b588d-ac3f-47d2-bf2a-d5bf3691d033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:16.059281 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a1021-6593-4a73-a285-d5631a3ff888 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:16.130563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 991/1991] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:16.130925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:16.131879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c052a8d-db0f-4db3-99fb-7d7baf039b78 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:16.132106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:16.132209 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c052a8d-db0f-4db3-99fb-7d7baf039b78 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:16.132396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:16.132493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c052a8d-db0f-4db3-99fb-7d7baf039b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:16.132680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] PATH_INFO: `/v3/users/f018c6dad204452f845e5be2bed7a54d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:16.134413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f018c6dad204452f845e5be2bed7a54d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:16.136323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:16.168368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5c052a8d-db0f-4db3-99fb-7d7baf039b78 None None] MFA Rules not processed for user `6d1cdf36ab1a42ba9516fb3b3ec22e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:16.169651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5c052a8d-db0f-4db3-99fb-7d7baf039b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:16.238056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 992/1992] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:16.238915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c052a8d-db0f-4db3-99fb-7d7baf039b78 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:16.295766 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c052a8d-db0f-4db3-99fb-7d7baf039b78 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:16.299689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82ada-c71f-47da-a772-2d3b23fe2317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:16.300363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82ada-c71f-47da-a772-2d3b23fe2317 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:16.300654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82ada-c71f-47da-a772-2d3b23fe2317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:16.300936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82ada-c71f-47da-a772-2d3b23fe2317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:16.310587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d82ada-c71f-47da-a772-2d3b23fe2317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:16.312148 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d82ada-c71f-47da-a772-2d3b23fe2317 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:16.319082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f018c6dad204452f845e5be2bed7a54d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:16.319879 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f018c6dad204452f845e5be2bed7a54d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:16.320702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f018c6dad204452f845e5be2bed7a54d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:16.322542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 993/1993] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:16.323211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82ada-c71f-47da-a772-2d3b23fe2317 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:16.336228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82ada-c71f-47da-a772-2d3b23fe2317 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:16.336355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f018c6dad204452f845e5be2bed7a54d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:16.339379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43dadb-eabb-4784-be14-05364cd4bc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:16.340038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43dadb-eabb-4784-be14-05364cd4bc60 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:16.340383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43dadb-eabb-4784-be14-05364cd4bc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:16.340674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43dadb-eabb-4784-be14-05364cd4bc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:16.341459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43dadb-eabb-4784-be14-05364cd4bc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:16.342965 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-92e16259-0871-427f-9e04-0a876e552fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f018c6dad204452f845e5be2bed7a54d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:16.343498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43dadb-eabb-4784-be14-05364cd4bc60 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:16.435948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1001/1994] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:15 2022] DELETE /identity/v3/users/f018c6dad204452f845e5be2bed7a54d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:16.440723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 994/1995] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:16 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:16.441693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68ea98-0d81-4404-9241-fd93d1da8f20 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:16.441693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68ea98-0d81-4404-9241-fd93d1da8f20 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:16.442012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43dadb-eabb-4784-be14-05364cd4bc60 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:16.442103 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68ea98-0d81-4404-9241-fd93d1da8f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:16.443977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4b43dadb-eabb-4784-be14-05364cd4bc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:16.460687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8e68ea98-0d81-4404-9241-fd93d1da8f20 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:16.462201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8e68ea98-0d81-4404-9241-fd93d1da8f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:16.525811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43dadb-eabb-4784-be14-05364cd4bc60 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:16.532926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f930b3-2b50-4c87-a135-313a641de891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:16.533773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f930b3-2b50-4c87-a135-313a641de891 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:16.534074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f930b3-2b50-4c87-a135-313a641de891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:16.534344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f930b3-2b50-4c87-a135-313a641de891 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:16.535054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f930b3-2b50-4c87-a135-313a641de891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:16.537573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f930b3-2b50-4c87-a135-313a641de891 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:16.541509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1002/1996] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:16.552099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68ea98-0d81-4404-9241-fd93d1da8f20 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:16.553608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8e68ea98-0d81-4404-9241-fd93d1da8f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:16.614678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68ea98-0d81-4404-9241-fd93d1da8f20 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:16.619322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4cbde-1668-484f-b748-b7580061645b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:16.620083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4cbde-1668-484f-b748-b7580061645b service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:16.620442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4cbde-1668-484f-b748-b7580061645b service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:16.620793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4cbde-1668-484f-b748-b7580061645b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:16.635283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4cbde-1668-484f-b748-b7580061645b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:16.636827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4cbde-1668-484f-b748-b7580061645b service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:16.649008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1003/1997] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:39:16.660832 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 995/1998] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:16 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:16.664400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4cbde-1668-484f-b748-b7580061645b service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:16.678689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4cbde-1668-484f-b748-b7580061645b service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:16.684888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafdf91-97c4-4391-b204-abc2388bf784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:16.685740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafdf91-97c4-4391-b204-abc2388bf784 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:16.686129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafdf91-97c4-4391-b204-abc2388bf784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:16.686568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafdf91-97c4-4391-b204-abc2388bf784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:16.688240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafdf91-97c4-4391-b204-abc2388bf784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:16.690454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafdf91-97c4-4391-b204-abc2388bf784 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:16.709340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1004/1999] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:16.711608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f930b3-2b50-4c87-a135-313a641de891 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:16.733659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f930b3-2b50-4c87-a135-313a641de891 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:16.741621 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138f177-f009-455e-aaae-be191d9b3be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:16.742658 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138f177-f009-455e-aaae-be191d9b3be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:16.742948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138f177-f009-455e-aaae-be191d9b3be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:16.743223 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138f177-f009-455e-aaae-be191d9b3be0 admin admin] PATH_INFO: `/v3/projects/e77de48277304f37a555acd80ee873d0/users/32059886b9c74a5eade75db6d80096cb/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:16.778930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138f177-f009-455e-aaae-be191d9b3be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77de48277304f37a555acd80ee873d0, user_id=32059886b9c74a5eade75db6d80096cb, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:16.783753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138f177-f009-455e-aaae-be191d9b3be0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:16.914224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 996/2000] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:16 2022] PUT /identity/v3/projects/e77de48277304f37a555acd80ee873d0/users/32059886b9c74a5eade75db6d80096cb/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:16.924532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafdf91-97c4-4391-b204-abc2388bf784 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:16.947328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafdf91-97c4-4391-b204-abc2388bf784 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:17.068474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7933-7228-4337-bac9-f6db229a76eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:17.069953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7933-7228-4337-bac9-f6db229a76eb admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:17.070588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7933-7228-4337-bac9-f6db229a76eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:17.071050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7933-7228-4337-bac9-f6db229a76eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:17.073600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d7933-7228-4337-bac9-f6db229a76eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:17.076241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d7933-7228-4337-bac9-f6db229a76eb admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:17.099813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1005/2001] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:39:17.106601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138f177-f009-455e-aaae-be191d9b3be0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:17.121016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138f177-f009-455e-aaae-be191d9b3be0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:17.127241 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b4a5-1d32-4ec9-8638-0c761bd4d8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:17.128426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b4a5-1d32-4ec9-8638-0c761bd4d8ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:17.128714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b4a5-1d32-4ec9-8638-0c761bd4d8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:17.129257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b4a5-1d32-4ec9-8638-0c761bd4d8ee admin admin] PATH_INFO: `/v3/projects/e77de48277304f37a555acd80ee873d0/users/32059886b9c74a5eade75db6d80096cb/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:17.131297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7b4a5-1d32-4ec9-8638-0c761bd4d8ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e77de48277304f37a555acd80ee873d0, user_id=32059886b9c74a5eade75db6d80096cb, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:17.134891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7b4a5-1d32-4ec9-8638-0c761bd4d8ee admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:17.148142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 997/2002] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:17 2022] PUT /identity/v3/projects/e77de48277304f37a555acd80ee873d0/users/32059886b9c74a5eade75db6d80096cb/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:17.169666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b6618-6421-4c40-a29d-072894259dbe None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:17.169967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b6618-6421-4c40-a29d-072894259dbe None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:17.170250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b6618-6421-4c40-a29d-072894259dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:17.236017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-4a4b6618-6421-4c40-a29d-072894259dbe None None] MFA Rules not processed for user `32059886b9c74a5eade75db6d80096cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:17.240125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4a4b6618-6421-4c40-a29d-072894259dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:17.347107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b4a5-1d32-4ec9-8638-0c761bd4d8ee admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:17.350354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f8c7b4a5-1d32-4ec9-8638-0c761bd4d8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:17.355125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1006/2003] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:17.372369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b6618-6421-4c40-a29d-072894259dbe None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:17.374420 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4a4b6618-6421-4c40-a29d-072894259dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:17.498637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b6618-6421-4c40-a29d-072894259dbe None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:17.510482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3681-7bc9-48b9-a5f2-9bf7b2801a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:17.510752 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3681-7bc9-48b9-a5f2-9bf7b2801a23 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:17.513516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3681-7bc9-48b9-a5f2-9bf7b2801a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:17.520983 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3681-7bc9-48b9-a5f2-9bf7b2801a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:17.536784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3681-7bc9-48b9-a5f2-9bf7b2801a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:17.538548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3681-7bc9-48b9-a5f2-9bf7b2801a23 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:17.549916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b4a5-1d32-4ec9-8638-0c761bd4d8ee admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:17.560584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:17.562067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:17.562407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:17.562689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] PATH_INFO: `/v3/projects/f34c4289600d4a36a1b8920769f09037` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:17.564421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1007/2004] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:17.566444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34c4289600d4a36a1b8920769f09037)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:17.569233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:17.642959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3681-7bc9-48b9-a5f2-9bf7b2801a23 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:17.644345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0c1f3681-7bc9-48b9-a5f2-9bf7b2801a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:17.656621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3681-7bc9-48b9-a5f2-9bf7b2801a23 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:17.660744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ed6ec-dddb-4db6-b21c-5a000777f8a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:17.661381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ed6ec-dddb-4db6-b21c-5a000777f8a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:17.661672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ed6ec-dddb-4db6-b21c-5a000777f8a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:17.661952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ed6ec-dddb-4db6-b21c-5a000777f8a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:17.663776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b87ed6ec-dddb-4db6-b21c-5a000777f8a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:17.755131 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ed6ec-dddb-4db6-b21c-5a000777f8a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:17.756605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ed6ec-dddb-4db6-b21c-5a000777f8a5 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:17.776569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1008/2005] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:39:17.787925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34c4289600d4a36a1b8920769f09037', 'request_id': 'req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:17.803737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34c4289600d4a36a1b8920769f09037', 'request_id': 'req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:17.961718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34c4289600d4a36a1b8920769f09037', 'request_id': 'req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:17.977153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] The token cache is being invalidate because project f34c4289600d4a36a1b8920769f09037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:17.977685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:17.978489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7a4ab49b-4f5c-45fa-9fc5-2a0c9c9600fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:17.980594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 998/2006] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:17 2022] DELETE /identity/v3/projects/f34c4289600d4a36a1b8920769f09037 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:39:17.984096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ed6ec-dddb-4db6-b21c-5a000777f8a5 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:17.996285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ed6ec-dddb-4db6-b21c-5a000777f8a5 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:18.092149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:18.093050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:18.093363 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:18.094392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] PATH_INFO: `/v3/users/0a2caa29a3f84770b60eedd56fd7d4a5` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:18.096446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2caa29a3f84770b60eedd56fd7d4a5)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:18.099460 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:18.198243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ef7e8-e3dc-469c-b338-352499454634 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:18.198533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ef7e8-e3dc-469c-b338-352499454634 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:18.198824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ef7e8-e3dc-469c-b338-352499454634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:18.234248 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-be3ef7e8-e3dc-469c-b338-352499454634 None None] MFA Rules not processed for user `eb3a1cc28fbe48b18d0fd19415cd7a53`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:18.235882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-be3ef7e8-e3dc-469c-b338-352499454634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:18.316219 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 999/2007] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:18.335307 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ef7e8-e3dc-469c-b338-352499454634 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:18.336805 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-be3ef7e8-e3dc-469c-b338-352499454634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:18.419333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2caa29a3f84770b60eedd56fd7d4a5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:18.420133 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2caa29a3f84770b60eedd56fd7d4a5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:18.423864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2caa29a3f84770b60eedd56fd7d4a5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:18.436083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ef7e8-e3dc-469c-b338-352499454634 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:18.438579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2caa29a3f84770b60eedd56fd7d4a5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:18.440880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0743a-714e-4290-95a4-371f504dff45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:18.441504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0743a-714e-4290-95a4-371f504dff45 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:18.441792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0743a-714e-4290-95a4-371f504dff45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:18.442064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0743a-714e-4290-95a4-371f504dff45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:18.443971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-72b0743a-714e-4290-95a4-371f504dff45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:18.446469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d2a9534a-9011-4237-89f7-0dc207677dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2caa29a3f84770b60eedd56fd7d4a5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:18.459884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0743a-714e-4290-95a4-371f504dff45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:18.463335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0743a-714e-4290-95a4-371f504dff45 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:18.472125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1000/2008] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:39:18.678257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1009/2009] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:17 2022] DELETE /identity/v3/users/0a2caa29a3f84770b60eedd56fd7d4a5 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:19.186780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0743a-714e-4290-95a4-371f504dff45 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:19.188968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-72b0743a-714e-4290-95a4-371f504dff45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:19.242047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0743a-714e-4290-95a4-371f504dff45 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:19.392588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:19.393826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:19.395315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:19.395615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] PATH_INFO: `/v3/projects/8f3f132c277e4acabf1b127ee2fbfdfb` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:19.397399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3f132c277e4acabf1b127ee2fbfdfb)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:19.399205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:19.572488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3f132c277e4acabf1b127ee2fbfdfb', 'request_id': 'req-4bae4125-4581-41ce-a2c0-aec60d15e10d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:19.580606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3f132c277e4acabf1b127ee2fbfdfb', 'request_id': 'req-4bae4125-4581-41ce-a2c0-aec60d15e10d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:19.663283 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3f132c277e4acabf1b127ee2fbfdfb', 'request_id': 'req-4bae4125-4581-41ce-a2c0-aec60d15e10d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:19.676234 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] The token cache is being invalidate because project 8f3f132c277e4acabf1b127ee2fbfdfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:19.676836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:19.677678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:19.679424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1001/2010] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:19 2022] DELETE /identity/v3/projects/8f3f132c277e4acabf1b127ee2fbfdfb => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:19.684487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0848a-da8d-4ba4-89c0-bef981fd93c4 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:19.685014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0848a-da8d-4ba4-89c0-bef981fd93c4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:19.685014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0848a-da8d-4ba4-89c0-bef981fd93c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:19.719815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-2de0848a-da8d-4ba4-89c0-bef981fd93c4 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:19.721329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2de0848a-da8d-4ba4-89c0-bef981fd93c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:19.744209 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:19.746079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:19.815528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1010/2011] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:19.821997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef3e88-d193-4807-8fcf-127b1fc3e93d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:19.822374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef3e88-d193-4807-8fcf-127b1fc3e93d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:19.827481 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef3e88-d193-4807-8fcf-127b1fc3e93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:19.873425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-74ef3e88-d193-4807-8fcf-127b1fc3e93d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:19.873714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae4125-4581-41ce-a2c0-aec60d15e10d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:19.880338 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-74ef3e88-d193-4807-8fcf-127b1fc3e93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:19.900574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd13482-176f-43a0-9589-86e2a374e94c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:19.901288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13482-176f-43a0-9589-86e2a374e94c service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:19.901953 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13482-176f-43a0-9589-86e2a374e94c service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:19.901953 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd13482-176f-43a0-9589-86e2a374e94c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:19.911084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1011/2012] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:19.913587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-afd13482-176f-43a0-9589-86e2a374e94c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:19.918823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef3e88-d193-4807-8fcf-127b1fc3e93d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:19.942170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef3e88-d193-4807-8fcf-127b1fc3e93d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:19.958476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d622d11-c21d-463c-8993-e77042409f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:19.959261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d622d11-c21d-463c-8993-e77042409f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:19.959456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d622d11-c21d-463c-8993-e77042409f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:19.959732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d622d11-c21d-463c-8993-e77042409f02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:19.963472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d622d11-c21d-463c-8993-e77042409f02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:19.963745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d622d11-c21d-463c-8993-e77042409f02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:19.965910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d622d11-c21d-463c-8993-e77042409f02 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:20.001217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1012/2013] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:39:20.002238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d622d11-c21d-463c-8993-e77042409f02 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:20.004915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6d622d11-c21d-463c-8993-e77042409f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:20.022640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d622d11-c21d-463c-8993-e77042409f02 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:20.049294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:20.050238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:20.050526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:20.050809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] PATH_INFO: `/v3/users/6d1cdf36ab1a42ba9516fb3b3ec22e4e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:20.052153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1cdf36ab1a42ba9516fb3b3ec22e4e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:20.054129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:20.084074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd13482-176f-43a0-9589-86e2a374e94c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:20.087038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd13482-176f-43a0-9589-86e2a374e94c service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:20.102391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1002/2014] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:20.104161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd13482-176f-43a0-9589-86e2a374e94c service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:20.120797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd13482-176f-43a0-9589-86e2a374e94c service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:20.128896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165acc3-ec8c-4a88-86f5-de6ffc904b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:20.129962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165acc3-ec8c-4a88-86f5-de6ffc904b25 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:20.130351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165acc3-ec8c-4a88-86f5-de6ffc904b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:20.130752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165acc3-ec8c-4a88-86f5-de6ffc904b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:20.132258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165acc3-ec8c-4a88-86f5-de6ffc904b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:20.135210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165acc3-ec8c-4a88-86f5-de6ffc904b25 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:20.262435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1cdf36ab1a42ba9516fb3b3ec22e4e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:20.263283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1cdf36ab1a42ba9516fb3b3ec22e4e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:20.294942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1cdf36ab1a42ba9516fb3b3ec22e4e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:20.298256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1003/2015] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:20 2022] POST /identity/v3/projects => generated 399 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:20.303045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165acc3-ec8c-4a88-86f5-de6ffc904b25 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:20.317741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a165acc3-ec8c-4a88-86f5-de6ffc904b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:20.322960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1cdf36ab1a42ba9516fb3b3ec22e4e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:20.336836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ef3785a0-7e45-4d60-bf50-33a4da579667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1cdf36ab1a42ba9516fb3b3ec22e4e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:20.413264 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165acc3-ec8c-4a88-86f5-de6ffc904b25 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:20.418538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f3576-72dc-4d08-9078-8422385aa808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:20.419476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f3576-72dc-4d08-9078-8422385aa808 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:20.419988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f3576-72dc-4d08-9078-8422385aa808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:20.420439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f3576-72dc-4d08-9078-8422385aa808 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:20.421363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f3576-72dc-4d08-9078-8422385aa808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:20.424431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f3576-72dc-4d08-9078-8422385aa808 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:20.454729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1013/2016] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:20 2022] DELETE /identity/v3/users/6d1cdf36ab1a42ba9516fb3b3ec22e4e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:20.456328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe24c-b848-45d7-bf5e-640f40af6018 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:20.456826 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe24c-b848-45d7-bf5e-640f40af6018 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:20.457080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe24c-b848-45d7-bf5e-640f40af6018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:20.494214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-e7ffe24c-b848-45d7-bf5e-640f40af6018 None None] MFA Rules not processed for user `eb3a1cc28fbe48b18d0fd19415cd7a53`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:20.494794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e7ffe24c-b848-45d7-bf5e-640f40af6018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:20.535104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1004/2017] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:20 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:20.537168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67311-079c-4913-bb0f-f4c5cb93bc5c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:20.538551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67311-079c-4913-bb0f-f4c5cb93bc5c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:20.539299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67311-079c-4913-bb0f-f4c5cb93bc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:20.559205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f2a67311-079c-4913-bb0f-f4c5cb93bc5c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:20.560483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f2a67311-079c-4913-bb0f-f4c5cb93bc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:20.599346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1014/2018] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:20.599976 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe24c-b848-45d7-bf5e-640f40af6018 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:20.663231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1005/2019] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:20.673762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67311-079c-4913-bb0f-f4c5cb93bc5c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:20.676434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f2a67311-079c-4913-bb0f-f4c5cb93bc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:20.739301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe24c-b848-45d7-bf5e-640f40af6018 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:20.745961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f80d3-ed6d-478d-91c9-e49e612a306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:20.747689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f80d3-ed6d-478d-91c9-e49e612a306b admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:20.748168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f80d3-ed6d-478d-91c9-e49e612a306b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:20.749237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f80d3-ed6d-478d-91c9-e49e612a306b admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:20.751158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f80d3-ed6d-478d-91c9-e49e612a306b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:20.753565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f80d3-ed6d-478d-91c9-e49e612a306b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:20.758339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67311-079c-4913-bb0f-f4c5cb93bc5c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:20.763414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c276b0-cd3c-4066-9eb9-608d95b969a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:20.764673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c276b0-cd3c-4066-9eb9-608d95b969a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:20.765044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c276b0-cd3c-4066-9eb9-608d95b969a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:20.765628 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c276b0-cd3c-4066-9eb9-608d95b969a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:20.769500 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1015/2020] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:20.776871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c276b0-cd3c-4066-9eb9-608d95b969a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:20.778586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c276b0-cd3c-4066-9eb9-608d95b969a3 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:20.786896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f80d3-ed6d-478d-91c9-e49e612a306b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:20.809047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1006/2021] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:39:20.813699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f80d3-ed6d-478d-91c9-e49e612a306b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:20.819794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26730f11-1350-4f59-bb88-039905955946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:20.820556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730f11-1350-4f59-bb88-039905955946 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:20.821048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730f11-1350-4f59-bb88-039905955946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:20.821800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730f11-1350-4f59-bb88-039905955946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:20.822717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730f11-1350-4f59-bb88-039905955946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:20.824913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730f11-1350-4f59-bb88-039905955946 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:20.839928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1016/2022] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:20.845264 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c276b0-cd3c-4066-9eb9-608d95b969a3 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:20.856797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c276b0-cd3c-4066-9eb9-608d95b969a3 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:20.866172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331efc6-d2f6-496d-9f93-3c75246d58db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:20.867152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331efc6-d2f6-496d-9f93-3c75246d58db admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:20.867450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331efc6-d2f6-496d-9f93-3c75246d58db admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:20.867725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331efc6-d2f6-496d-9f93-3c75246d58db admin admin] PATH_INFO: `/v3/projects/51508f94be3147f0b397acc0a1d1c37d/users/683da6dd873d40e8b392283b1ca6e715/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:20.903956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331efc6-d2f6-496d-9f93-3c75246d58db admin admin] RBAC: Authorizing `identity:create_grant(project_id=51508f94be3147f0b397acc0a1d1c37d, user_id=683da6dd873d40e8b392283b1ca6e715, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:20.911819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331efc6-d2f6-496d-9f93-3c75246d58db admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:21.017620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1007/2023] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:20 2022] PUT /identity/v3/projects/51508f94be3147f0b397acc0a1d1c37d/users/683da6dd873d40e8b392283b1ca6e715/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:21.019394 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f954a-81d0-4880-a884-ab55d98986e5 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:21.019702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f954a-81d0-4880-a884-ab55d98986e5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:21.019988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f954a-81d0-4880-a884-ab55d98986e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:21.049365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f56f954a-81d0-4880-a884-ab55d98986e5 None None] MFA Rules not processed for user `683da6dd873d40e8b392283b1ca6e715`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:21.050759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f56f954a-81d0-4880-a884-ab55d98986e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:21.153024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1017/2024] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:21.165010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331efc6-d2f6-496d-9f93-3c75246d58db admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:21.167407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d331efc6-d2f6-496d-9f93-3c75246d58db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:21.250839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331efc6-d2f6-496d-9f93-3c75246d58db admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:21.256659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d30c-5eaf-4a69-a0c9-d2c29c91592e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:21.257509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d30c-5eaf-4a69-a0c9-d2c29c91592e service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:21.257744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d30c-5eaf-4a69-a0c9-d2c29c91592e service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:21.258026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d30c-5eaf-4a69-a0c9-d2c29c91592e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:21.270171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45d30c-5eaf-4a69-a0c9-d2c29c91592e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:21.271935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45d30c-5eaf-4a69-a0c9-d2c29c91592e service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:21.295471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1008/2025] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:21.403033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f954a-81d0-4880-a884-ab55d98986e5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:21.407403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f56f954a-81d0-4880-a884-ab55d98986e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:21.590347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f954a-81d0-4880-a884-ab55d98986e5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:21.600577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:21.601572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:21.601865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:21.602150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] PATH_INFO: `/v3/projects/2173eca79ba24a31b45892d8d8a29159` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:21.604470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2173eca79ba24a31b45892d8d8a29159)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:21.606441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:21.869233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2173eca79ba24a31b45892d8d8a29159', 'request_id': 'req-05d0ffe5-468d-435a-b544-9cdd456972ea'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:21.889523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2173eca79ba24a31b45892d8d8a29159', 'request_id': 'req-05d0ffe5-468d-435a-b544-9cdd456972ea'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:21.978090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2173eca79ba24a31b45892d8d8a29159', 'request_id': 'req-05d0ffe5-468d-435a-b544-9cdd456972ea'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:21.999028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] The token cache is being invalidate because project 2173eca79ba24a31b45892d8d8a29159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:21.999326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:22.000192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-05d0ffe5-468d-435a-b544-9cdd456972ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:22.005071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1018/2026] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:21 2022] DELETE /identity/v3/projects/2173eca79ba24a31b45892d8d8a29159 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:22.006174 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d30c-5eaf-4a69-a0c9-d2c29c91592e service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:22.018415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d30c-5eaf-4a69-a0c9-d2c29c91592e service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:22.113476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:22.114362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:22.114655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:22.114939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] PATH_INFO: `/v3/users/32059886b9c74a5eade75db6d80096cb` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:22.116324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32059886b9c74a5eade75db6d80096cb)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:22.118374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:22.371786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32059886b9c74a5eade75db6d80096cb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:22.394770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32059886b9c74a5eade75db6d80096cb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:22.407971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32059886b9c74a5eade75db6d80096cb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:22.523470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32059886b9c74a5eade75db6d80096cb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:22.533495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32059886b9c74a5eade75db6d80096cb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:22.540236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1009/2027] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:22 2022] DELETE /identity/v3/users/32059886b9c74a5eade75db6d80096cb => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:22.946055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e094fa-3b30-4218-9fc2-abbc026a2822 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:22.946558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e094fa-3b30-4218-9fc2-abbc026a2822 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:22.946657 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e094fa-3b30-4218-9fc2-abbc026a2822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:22.992099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-46e094fa-3b30-4218-9fc2-abbc026a2822 None None] MFA Rules not processed for user `e3fa08cd466c419e80198a5b44b719f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:22.994235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-46e094fa-3b30-4218-9fc2-abbc026a2822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:23.125951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1019/2028] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:23.142047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:23.143636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:23.207354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e094fa-3b30-4218-9fc2-abbc026a2822 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:23.209575 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-46e094fa-3b30-4218-9fc2-abbc026a2822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:23.288182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be544d4-ce27-4079-9639-314a89676123 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:23.296988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99f9a0-74eb-4e7b-9497-1bac70227f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:23.299070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99f9a0-74eb-4e7b-9497-1bac70227f26 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:23.299528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99f9a0-74eb-4e7b-9497-1bac70227f26 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:23.300375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99f9a0-74eb-4e7b-9497-1bac70227f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:23.312908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99f9a0-74eb-4e7b-9497-1bac70227f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:23.315486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99f9a0-74eb-4e7b-9497-1bac70227f26 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:23.335717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e094fa-3b30-4218-9fc2-abbc026a2822 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:23.339268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1010/2029] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:23.354312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:23.355581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:23.356152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:23.357332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] PATH_INFO: `/v3/projects/e77de48277304f37a555acd80ee873d0` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:23.359693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e77de48277304f37a555acd80ee873d0)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:23.363198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:23.569591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77de48277304f37a555acd80ee873d0', 'request_id': 'req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:23.584336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77de48277304f37a555acd80ee873d0', 'request_id': 'req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:23.694157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77de48277304f37a555acd80ee873d0', 'request_id': 'req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:23.706980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] The token cache is being invalidate because project e77de48277304f37a555acd80ee873d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:23.707465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:23.708147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bf9a6e42-ba7b-4948-828a-0bfafc288a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:23.709799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1020/2030] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:23 2022] DELETE /identity/v3/projects/e77de48277304f37a555acd80ee873d0 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:23.715307 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13706fbf-b792-4904-bd51-482e494c47cd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:23.715605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13706fbf-b792-4904-bd51-482e494c47cd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:23.715884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13706fbf-b792-4904-bd51-482e494c47cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:23.735920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-13706fbf-b792-4904-bd51-482e494c47cd None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:23.737136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-13706fbf-b792-4904-bd51-482e494c47cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:23.809020 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1011/2031] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:23.817612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eb18d-e253-4c52-9bdf-50017aa6ee66 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:23.817811 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eb18d-e253-4c52-9bdf-50017aa6ee66 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:23.817953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eb18d-e253-4c52-9bdf-50017aa6ee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:23.850026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-7e1eb18d-e253-4c52-9bdf-50017aa6ee66 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:23.851596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7e1eb18d-e253-4c52-9bdf-50017aa6ee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:23.884406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1021/2032] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:23.888688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13706fbf-b792-4904-bd51-482e494c47cd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:23.900896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13706fbf-b792-4904-bd51-482e494c47cd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:23.906291 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53d2c8-8da0-41a5-a024-a9513034dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:23.907033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53d2c8-8da0-41a5-a024-a9513034dd56 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:23.907390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53d2c8-8da0-41a5-a024-a9513034dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:23.907841 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53d2c8-8da0-41a5-a024-a9513034dd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:23.908668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53d2c8-8da0-41a5-a024-a9513034dd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:23.909053 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53d2c8-8da0-41a5-a024-a9513034dd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:23.910734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53d2c8-8da0-41a5-a024-a9513034dd56 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:23.929661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1012/2033] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:39:23.930979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eb18d-e253-4c52-9bdf-50017aa6ee66 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:23.947901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eb18d-e253-4c52-9bdf-50017aa6ee66 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:23.952703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388d64c-90c4-486b-a214-3fc79f6f82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:23.953430 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d64c-90c4-486b-a214-3fc79f6f82a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:23.953724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d64c-90c4-486b-a214-3fc79f6f82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:23.954006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d64c-90c4-486b-a214-3fc79f6f82a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:23.954712 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388d64c-90c4-486b-a214-3fc79f6f82a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:23.956614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388d64c-90c4-486b-a214-3fc79f6f82a2 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:24.086848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1022/2034] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:23 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:24.088587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53d2c8-8da0-41a5-a024-a9513034dd56 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:24.099850 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53d2c8-8da0-41a5-a024-a9513034dd56 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:24.226851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848f5ea-6da0-4fa6-8438-ece3b370194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:24.227639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848f5ea-6da0-4fa6-8438-ece3b370194c admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:24.227823 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848f5ea-6da0-4fa6-8438-ece3b370194c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:24.228101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848f5ea-6da0-4fa6-8438-ece3b370194c admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:24.228828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848f5ea-6da0-4fa6-8438-ece3b370194c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:24.230914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848f5ea-6da0-4fa6-8438-ece3b370194c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:24.344809 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1013/2035] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:24 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:24.349049 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388d64c-90c4-486b-a214-3fc79f6f82a2 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:24.361561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388d64c-90c4-486b-a214-3fc79f6f82a2 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:24.374079 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed16d5b-62a9-4fd6-af05-feb6de58e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:24.375419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16d5b-62a9-4fd6-af05-feb6de58e969 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:24.375784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16d5b-62a9-4fd6-af05-feb6de58e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:24.376151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16d5b-62a9-4fd6-af05-feb6de58e969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:24.377081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed16d5b-62a9-4fd6-af05-feb6de58e969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:24.379171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed16d5b-62a9-4fd6-af05-feb6de58e969 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:24.392510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1023/2036] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:24.396928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848f5ea-6da0-4fa6-8438-ece3b370194c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:24.413921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848f5ea-6da0-4fa6-8438-ece3b370194c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:24.420761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e913096-21d8-458b-9933-9b2777dcd022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:24.420761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e913096-21d8-458b-9933-9b2777dcd022 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:24.421344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e913096-21d8-458b-9933-9b2777dcd022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:24.422926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e913096-21d8-458b-9933-9b2777dcd022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:24.423751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e913096-21d8-458b-9933-9b2777dcd022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:24.425421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e913096-21d8-458b-9933-9b2777dcd022 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:24.439455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1014/2037] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:39:24.441464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed16d5b-62a9-4fd6-af05-feb6de58e969 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:24.457954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed16d5b-62a9-4fd6-af05-feb6de58e969 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:24.464794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eab243-9d95-45b9-b52c-e3ef70cfa932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:24.465795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eab243-9d95-45b9-b52c-e3ef70cfa932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:24.466254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eab243-9d95-45b9-b52c-e3ef70cfa932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:24.466747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eab243-9d95-45b9-b52c-e3ef70cfa932 admin admin] PATH_INFO: `/v3/projects/1bc22d831d114f978dcaa43311f7c6f9/users/3b930571934b4c8b92891278f8fa0bc5/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:24.493058 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eab243-9d95-45b9-b52c-e3ef70cfa932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc22d831d114f978dcaa43311f7c6f9, user_id=3b930571934b4c8b92891278f8fa0bc5, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:24.499733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eab243-9d95-45b9-b52c-e3ef70cfa932 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:24.610809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1024/2038] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:24 2022] PUT /identity/v3/projects/1bc22d831d114f978dcaa43311f7c6f9/users/3b930571934b4c8b92891278f8fa0bc5/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:24.622692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9b3a-c9ec-4b8e-9935-6c768af64252 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:24.623088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9b3a-c9ec-4b8e-9935-6c768af64252 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:24.623665 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9b3a-c9ec-4b8e-9935-6c768af64252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:24.655986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fd3e9b3a-c9ec-4b8e-9935-6c768af64252 None None] MFA Rules not processed for user `3b930571934b4c8b92891278f8fa0bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:24.657986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fd3e9b3a-c9ec-4b8e-9935-6c768af64252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:24.723977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1015/2039] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:24.728426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eab243-9d95-45b9-b52c-e3ef70cfa932 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:24.790155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eab243-9d95-45b9-b52c-e3ef70cfa932 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:24.795901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf9585-5389-4549-8667-8cd0724be310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:24.797215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9585-5389-4549-8667-8cd0724be310 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:24.797675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9585-5389-4549-8667-8cd0724be310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:24.798126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9585-5389-4549-8667-8cd0724be310 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:24.799006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf9585-5389-4549-8667-8cd0724be310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:24.801170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf9585-5389-4549-8667-8cd0724be310 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:24.933810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1025/2040] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:24 2022] POST /identity/v3/projects => generated 363 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:24.936383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e9b3a-c9ec-4b8e-9935-6c768af64252 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:24.955811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e9b3a-c9ec-4b8e-9935-6c768af64252 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:25.050121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e66ef-df9f-4231-8d0d-dcc858a75e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:25.051004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e66ef-df9f-4231-8d0d-dcc858a75e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:25.051385 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e66ef-df9f-4231-8d0d-dcc858a75e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:25.051792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e66ef-df9f-4231-8d0d-dcc858a75e20 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:25.052802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e66ef-df9f-4231-8d0d-dcc858a75e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:25.055807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e66ef-df9f-4231-8d0d-dcc858a75e20 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:25.177347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1016/2041] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:24 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:25.179677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf9585-5389-4549-8667-8cd0724be310 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:25.192526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf9585-5389-4549-8667-8cd0724be310 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:25.197549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c9dbf-3394-4d6a-bdae-fa9780dfb039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:25.200633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c9dbf-3394-4d6a-bdae-fa9780dfb039 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:25.200633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c9dbf-3394-4d6a-bdae-fa9780dfb039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:25.200633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c9dbf-3394-4d6a-bdae-fa9780dfb039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:25.200633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c9dbf-3394-4d6a-bdae-fa9780dfb039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:25.201470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c9dbf-3394-4d6a-bdae-fa9780dfb039 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:25.214135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1026/2042] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:25.219774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e66ef-df9f-4231-8d0d-dcc858a75e20 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:25.233498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e66ef-df9f-4231-8d0d-dcc858a75e20 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:25.241128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c820-64cd-4d2f-8f6d-522ef1116290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:25.242200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c820-64cd-4d2f-8f6d-522ef1116290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:25.242586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c820-64cd-4d2f-8f6d-522ef1116290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:25.242936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c820-64cd-4d2f-8f6d-522ef1116290 admin admin] PATH_INFO: `/v3/projects/486e2b7f486b40ea8c26c82a8dc00f36/users/a2cb8d6cde504bb2938c5dc9ac29f7c5/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:25.266860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c820-64cd-4d2f-8f6d-522ef1116290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486e2b7f486b40ea8c26c82a8dc00f36, user_id=a2cb8d6cde504bb2938c5dc9ac29f7c5, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:25.273000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c820-64cd-4d2f-8f6d-522ef1116290 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:25.368852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1017/2043] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:25 2022] PUT /identity/v3/projects/486e2b7f486b40ea8c26c82a8dc00f36/users/a2cb8d6cde504bb2938c5dc9ac29f7c5/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:25.372482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c9dbf-3394-4d6a-bdae-fa9780dfb039 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:25.398357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c9dbf-3394-4d6a-bdae-fa9780dfb039 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:25.478051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86620b-d084-4043-9379-368c64528660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:25.479003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86620b-d084-4043-9379-368c64528660 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:25.479294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86620b-d084-4043-9379-368c64528660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:25.479576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86620b-d084-4043-9379-368c64528660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:25.480317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86620b-d084-4043-9379-368c64528660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:25.482062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86620b-d084-4043-9379-368c64528660 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:25.493903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1027/2044] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:25.498247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c820-64cd-4d2f-8f6d-522ef1116290 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:25.518864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c820-64cd-4d2f-8f6d-522ef1116290 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:25.524653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed9d9d-a283-4b59-8ea0-2fb0e4aac3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:25.526792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9d9d-a283-4b59-8ea0-2fb0e4aac3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:25.527835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9d9d-a283-4b59-8ea0-2fb0e4aac3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:25.528197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9d9d-a283-4b59-8ea0-2fb0e4aac3f0 admin admin] PATH_INFO: `/v3/projects/486e2b7f486b40ea8c26c82a8dc00f36/users/a2cb8d6cde504bb2938c5dc9ac29f7c5/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:25.530377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed9d9d-a283-4b59-8ea0-2fb0e4aac3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486e2b7f486b40ea8c26c82a8dc00f36, user_id=a2cb8d6cde504bb2938c5dc9ac29f7c5, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:25.534120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed9d9d-a283-4b59-8ea0-2fb0e4aac3f0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:25.548794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1018/2045] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:25 2022] PUT /identity/v3/projects/486e2b7f486b40ea8c26c82a8dc00f36/users/a2cb8d6cde504bb2938c5dc9ac29f7c5/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:25.558706 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2d182-1bf1-4f6f-97f0-b0a1d83e1365 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:25.559365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2d182-1bf1-4f6f-97f0-b0a1d83e1365 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:25.559856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2d182-1bf1-4f6f-97f0-b0a1d83e1365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:25.610868 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a9c2d182-1bf1-4f6f-97f0-b0a1d83e1365 None None] MFA Rules not processed for user `a2cb8d6cde504bb2938c5dc9ac29f7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:25.612257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a9c2d182-1bf1-4f6f-97f0-b0a1d83e1365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:25.721565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1028/2046] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:25 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:25.732367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed9d9d-a283-4b59-8ea0-2fb0e4aac3f0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:25.734368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9fed9d9d-a283-4b59-8ea0-2fb0e4aac3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:25.823647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed9d9d-a283-4b59-8ea0-2fb0e4aac3f0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:25.828226 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391102f1-3c92-4781-9f2d-6e1458a2def2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:25.828898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391102f1-3c92-4781-9f2d-6e1458a2def2 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:25.829189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391102f1-3c92-4781-9f2d-6e1458a2def2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:25.829503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391102f1-3c92-4781-9f2d-6e1458a2def2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:25.840274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391102f1-3c92-4781-9f2d-6e1458a2def2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:25.842641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391102f1-3c92-4781-9f2d-6e1458a2def2 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:25.855930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1019/2047] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:26.135534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2d182-1bf1-4f6f-97f0-b0a1d83e1365 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:26.145608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2d182-1bf1-4f6f-97f0-b0a1d83e1365 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:26.149354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84da2-48bc-434b-8197-c9750e261a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:26.150034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84da2-48bc-434b-8197-c9750e261a5e service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:26.150352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84da2-48bc-434b-8197-c9750e261a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:26.150634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba84da2-48bc-434b-8197-c9750e261a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:26.232806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba84da2-48bc-434b-8197-c9750e261a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:26.235054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba84da2-48bc-434b-8197-c9750e261a5e service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:26.245944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1029/2048] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:26.316783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fe498-2fff-482c-b692-d08fe6dd2d05 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:26.317335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fe498-2fff-482c-b692-d08fe6dd2d05 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:26.317453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fe498-2fff-482c-b692-d08fe6dd2d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:26.335851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0a1fe498-2fff-482c-b692-d08fe6dd2d05 None None] MFA Rules not processed for user `e3fa08cd466c419e80198a5b44b719f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:26.337129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0a1fe498-2fff-482c-b692-d08fe6dd2d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:26.394027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1020/2049] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:27.784637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84da2-48bc-434b-8197-c9750e261a5e service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:27.786208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bba84da2-48bc-434b-8197-c9750e261a5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:27.869914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba84da2-48bc-434b-8197-c9750e261a5e service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:27.875741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:27.876739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:27.877048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:27.877332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] PATH_INFO: `/v3/users/2f1a7cfda0754eedbd0d9540fa76db38` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:27.878793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1a7cfda0754eedbd0d9540fa76db38)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:27.880699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:28.141700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1a7cfda0754eedbd0d9540fa76db38'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:28.142388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1a7cfda0754eedbd0d9540fa76db38'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:28.142998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1a7cfda0754eedbd0d9540fa76db38'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:28.154619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1a7cfda0754eedbd0d9540fa76db38'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:28.162072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1a7cfda0754eedbd0d9540fa76db38'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:28.259425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1030/2050] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:27 2022] DELETE /identity/v3/users/2f1a7cfda0754eedbd0d9540fa76db38 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:28.264232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917ff90-e782-4c62-a497-af7988bb073a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:28.264780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917ff90-e782-4c62-a497-af7988bb073a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:28.264780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917ff90-e782-4c62-a497-af7988bb073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:28.284859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0917ff90-e782-4c62-a497-af7988bb073a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:28.286127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0917ff90-e782-4c62-a497-af7988bb073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:28.360677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1021/2051] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:28.369060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:28.371011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:28.433054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6481ea-9fc7-469e-90bf-1e9ac656205b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:28.522858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c9af-a670-48f0-a841-8d96692e8d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:28.522858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c9af-a670-48f0-a841-8d96692e8d3c service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:28.522858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c9af-a670-48f0-a841-8d96692e8d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:28.522858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c9af-a670-48f0-a841-8d96692e8d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:28.524629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2c9af-a670-48f0-a841-8d96692e8d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:28.524629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2c9af-a670-48f0-a841-8d96692e8d3c service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:28.524629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1031/2052] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:29.229104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917ff90-e782-4c62-a497-af7988bb073a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:29.229104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0917ff90-e782-4c62-a497-af7988bb073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:29.242289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917ff90-e782-4c62-a497-af7988bb073a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:29.254757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:29.256325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:29.256853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:29.257368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] PATH_INFO: `/v3/projects/0e5ab909ba3a44d2a554f4d753db644a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:29.262430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5ab909ba3a44d2a554f4d753db644a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:29.262430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:29.420945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5ab909ba3a44d2a554f4d753db644a', 'request_id': 'req-1e0ec7ef-e24c-4238-834c-417ad3341151'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:29.426985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5ab909ba3a44d2a554f4d753db644a', 'request_id': 'req-1e0ec7ef-e24c-4238-834c-417ad3341151'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:29.539314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5ab909ba3a44d2a554f4d753db644a', 'request_id': 'req-1e0ec7ef-e24c-4238-834c-417ad3341151'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:29.551584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] The token cache is being invalidate because project 0e5ab909ba3a44d2a554f4d753db644a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:29.552257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:29.553191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:29.554826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1022/2053] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:29 2022] DELETE /identity/v3/projects/0e5ab909ba3a44d2a554f4d753db644a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:29.558733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c9af-a670-48f0-a841-8d96692e8d3c service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:29.569240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c9af-a670-48f0-a841-8d96692e8d3c service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:29.628215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:29.632638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:29.632638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:29.632638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] PATH_INFO: `/v3/users/a4b356e33e174224bb5363eca49e34d6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:29.632638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b356e33e174224bb5363eca49e34d6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:29.633022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:29.905191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b356e33e174224bb5363eca49e34d6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:29.906240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b356e33e174224bb5363eca49e34d6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:29.907106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b356e33e174224bb5363eca49e34d6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:29.919577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b356e33e174224bb5363eca49e34d6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:29.927828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b356e33e174224bb5363eca49e34d6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:30.040060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1032/2054] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:29 2022] DELETE /identity/v3/users/a4b356e33e174224bb5363eca49e34d6 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:30.528097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:30.529689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:30.548180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ec7ef-e24c-4238-834c-417ad3341151 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:30.665266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:30.666636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:30.666636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:30.666810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] PATH_INFO: `/v3/projects/3385454d1eb84e7fa7ff611751870c26` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:30.668000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3385454d1eb84e7fa7ff611751870c26)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:30.669984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:30.850019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3385454d1eb84e7fa7ff611751870c26', 'request_id': 'req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:30.875067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3385454d1eb84e7fa7ff611751870c26', 'request_id': 'req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:30.995955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3385454d1eb84e7fa7ff611751870c26', 'request_id': 'req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.008283 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] The token cache is being invalidate because project 3385454d1eb84e7fa7ff611751870c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:31.008722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.009637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.011555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1023/2055] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:30 2022] DELETE /identity/v3/projects/3385454d1eb84e7fa7ff611751870c26 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:31.015325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:31.016897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:31.029708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c0f4-04b5-4ea1-988d-ae68eeee5942 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:31.098764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:31.099656 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:31.099951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:31.100234 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] PATH_INFO: `/v3/users/412c817c51c643ad8015b4138d206b03` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:31.101485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=412c817c51c643ad8015b4138d206b03)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:31.103414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:31.152333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:31.153921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:31.176139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6f2fa-3e34-4af2-bce2-8cd714911ddc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:31.180096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:31.181266 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:31.181580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:31.181856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] PATH_INFO: `/v3/users/683da6dd873d40e8b392283b1ca6e715` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:31.183606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=683da6dd873d40e8b392283b1ca6e715)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:31.185981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:31.330099 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412c817c51c643ad8015b4138d206b03'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.331224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412c817c51c643ad8015b4138d206b03'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.331904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412c817c51c643ad8015b4138d206b03'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.344016 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412c817c51c643ad8015b4138d206b03'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.351155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-623493a8-cde6-4f52-86f0-4d43035f81bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412c817c51c643ad8015b4138d206b03'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.514484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '683da6dd873d40e8b392283b1ca6e715'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.521363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '683da6dd873d40e8b392283b1ca6e715'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.524149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '683da6dd873d40e8b392283b1ca6e715'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.524484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1033/2056] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:31 2022] DELETE /identity/v3/users/412c817c51c643ad8015b4138d206b03 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:31.600847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '683da6dd873d40e8b392283b1ca6e715'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.610081 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '683da6dd873d40e8b392283b1ca6e715'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:31.617546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1024/2057] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:31 2022] DELETE /identity/v3/users/683da6dd873d40e8b392283b1ca6e715 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:31.621676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feb301-bba3-49c6-9e87-4170f30aea9e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:31.622092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feb301-bba3-49c6-9e87-4170f30aea9e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:31.622287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feb301-bba3-49c6-9e87-4170f30aea9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:31.642110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a5feb301-bba3-49c6-9e87-4170f30aea9e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:31.643343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a5feb301-bba3-49c6-9e87-4170f30aea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:31.708536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1034/2058] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:31.714148 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:31.715779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:31.783922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c6d5e-a5b0-4fd7-9c7e-129318d7acd4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:31.787616 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686daffd-8f04-4294-bb26-0262d5818430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:31.788292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686daffd-8f04-4294-bb26-0262d5818430 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:31.788576 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686daffd-8f04-4294-bb26-0262d5818430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:31.788887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686daffd-8f04-4294-bb26-0262d5818430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:31.798249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686daffd-8f04-4294-bb26-0262d5818430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:31.799843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686daffd-8f04-4294-bb26-0262d5818430 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:31.809418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1025/2059] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:32.038197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feb301-bba3-49c6-9e87-4170f30aea9e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:32.039639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a5feb301-bba3-49c6-9e87-4170f30aea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:32.066235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feb301-bba3-49c6-9e87-4170f30aea9e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:32.077958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:32.079105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:32.079572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:32.079852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] PATH_INFO: `/v3/projects/98b68dde47d44766a958a2a4e739f792` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:32.081148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b68dde47d44766a958a2a4e739f792)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:32.083122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:32.190637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b68dde47d44766a958a2a4e739f792', 'request_id': 'req-bb1cd3bf-64e8-4f20-9527-4c31fd233340'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:32.196021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b68dde47d44766a958a2a4e739f792', 'request_id': 'req-bb1cd3bf-64e8-4f20-9527-4c31fd233340'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:32.263027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b68dde47d44766a958a2a4e739f792', 'request_id': 'req-bb1cd3bf-64e8-4f20-9527-4c31fd233340'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:32.274499 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] The token cache is being invalidate because project 98b68dde47d44766a958a2a4e739f792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:32.279577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:32.279577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-bb1cd3bf-64e8-4f20-9527-4c31fd233340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:32.279577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1035/2060] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:32 2022] DELETE /identity/v3/projects/98b68dde47d44766a958a2a4e739f792 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:32.307761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686daffd-8f04-4294-bb26-0262d5818430 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:32.309829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-686daffd-8f04-4294-bb26-0262d5818430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:32.340843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686daffd-8f04-4294-bb26-0262d5818430 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:32.443243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:32.444140 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:32.444430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:32.444713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] PATH_INFO: `/v3/projects/51508f94be3147f0b397acc0a1d1c37d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:32.449129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51508f94be3147f0b397acc0a1d1c37d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:32.451182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:32.562380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51508f94be3147f0b397acc0a1d1c37d', 'request_id': 'req-f1531dc0-babf-462e-9213-a88b16c62ff5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:32.567787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51508f94be3147f0b397acc0a1d1c37d', 'request_id': 'req-f1531dc0-babf-462e-9213-a88b16c62ff5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:32.629893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51508f94be3147f0b397acc0a1d1c37d', 'request_id': 'req-f1531dc0-babf-462e-9213-a88b16c62ff5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:32.641194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] The token cache is being invalidate because project 51508f94be3147f0b397acc0a1d1c37d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:32.641514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:32.642137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1531dc0-babf-462e-9213-a88b16c62ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:32.643667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1026/2061] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:32 2022] DELETE /identity/v3/projects/51508f94be3147f0b397acc0a1d1c37d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:32.648498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681992c-c4c6-4a0d-b478-fb3b605a4ce2 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:32.648792 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681992c-c4c6-4a0d-b478-fb3b605a4ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:32.649078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681992c-c4c6-4a0d-b478-fb3b605a4ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:32.667564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-7681992c-c4c6-4a0d-b478-fb3b605a4ce2 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:32.668756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7681992c-c4c6-4a0d-b478-fb3b605a4ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:32.727445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1036/2062] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:32.736075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e99e90-ea6f-4780-a6ad-1cc8fde61737 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:32.736366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e99e90-ea6f-4780-a6ad-1cc8fde61737 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:32.736645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e99e90-ea6f-4780-a6ad-1cc8fde61737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:32.754718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-86e99e90-ea6f-4780-a6ad-1cc8fde61737 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:32.755911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-86e99e90-ea6f-4780-a6ad-1cc8fde61737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:32.763798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1027/2063] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:32.768600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681992c-c4c6-4a0d-b478-fb3b605a4ce2 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:32.777999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681992c-c4c6-4a0d-b478-fb3b605a4ce2 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:32.783102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb501-0c65-44cd-ad4a-055affd49396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:32.783748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb501-0c65-44cd-ad4a-055affd49396 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:32.784030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb501-0c65-44cd-ad4a-055affd49396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:32.784738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb501-0c65-44cd-ad4a-055affd49396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:32.785502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecb501-0c65-44cd-ad4a-055affd49396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:32.785900 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecb501-0c65-44cd-ad4a-055affd49396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:32.787494 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecb501-0c65-44cd-ad4a-055affd49396 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:32.798852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1037/2064] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:39:32.802937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e99e90-ea6f-4780-a6ad-1cc8fde61737 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:32.811754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e99e90-ea6f-4780-a6ad-1cc8fde61737 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:32.816455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede974-cb9b-4d49-a252-98934cfd93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:32.817175 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede974-cb9b-4d49-a252-98934cfd93bf admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:32.817492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede974-cb9b-4d49-a252-98934cfd93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:32.817767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede974-cb9b-4d49-a252-98934cfd93bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:32.818457 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ede974-cb9b-4d49-a252-98934cfd93bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:32.820323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ede974-cb9b-4d49-a252-98934cfd93bf admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:32.900652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1028/2065] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:32 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:32.903986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb501-0c65-44cd-ad4a-055affd49396 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:32.915102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb501-0c65-44cd-ad4a-055affd49396 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:32.971424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8a8b2-06b9-46ed-8f6a-2d392a58f832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:32.971990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8a8b2-06b9-46ed-8f6a-2d392a58f832 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:32.972273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8a8b2-06b9-46ed-8f6a-2d392a58f832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:32.972548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8a8b2-06b9-46ed-8f6a-2d392a58f832 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:32.973238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8a8b2-06b9-46ed-8f6a-2d392a58f832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:32.975182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8a8b2-06b9-46ed-8f6a-2d392a58f832 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:33.076348 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1038/2066] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:32 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:33.081012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede974-cb9b-4d49-a252-98934cfd93bf admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:33.091289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede974-cb9b-4d49-a252-98934cfd93bf admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:33.097676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6345784-4505-47f4-bbec-231723abf1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:33.098629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345784-4505-47f4-bbec-231723abf1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:33.099162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345784-4505-47f4-bbec-231723abf1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:33.099652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345784-4505-47f4-bbec-231723abf1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:33.100781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6345784-4505-47f4-bbec-231723abf1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:33.102762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6345784-4505-47f4-bbec-231723abf1cc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:33.117321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1029/2067] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:39:33.118621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8a8b2-06b9-46ed-8f6a-2d392a58f832 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:33.129634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8a8b2-06b9-46ed-8f6a-2d392a58f832 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:33.134451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb8bc4-fcef-414b-aa98-33a555eaed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:33.135114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb8bc4-fcef-414b-aa98-33a555eaed19 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:33.135402 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb8bc4-fcef-414b-aa98-33a555eaed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:33.135711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb8bc4-fcef-414b-aa98-33a555eaed19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:33.136439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb8bc4-fcef-414b-aa98-33a555eaed19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:33.138092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb8bc4-fcef-414b-aa98-33a555eaed19 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:33.148881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1039/2068] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:33.152859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6345784-4505-47f4-bbec-231723abf1cc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:33.162982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6345784-4505-47f4-bbec-231723abf1cc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:33.167587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2c786-7397-439e-8255-d83cd600de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:33.168464 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2c786-7397-439e-8255-d83cd600de9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:33.168747 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2c786-7397-439e-8255-d83cd600de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:33.169026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2c786-7397-439e-8255-d83cd600de9a admin admin] PATH_INFO: `/v3/projects/fcbad83733994c35979d60f1bbaf280c/users/d6afc66e1d4b473e9a8e6abf1737b64d/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:33.183505 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2c786-7397-439e-8255-d83cd600de9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbad83733994c35979d60f1bbaf280c, user_id=d6afc66e1d4b473e9a8e6abf1737b64d, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:33.186169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2c786-7397-439e-8255-d83cd600de9a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:33.266102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1030/2069] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:33 2022] PUT /identity/v3/projects/fcbad83733994c35979d60f1bbaf280c/users/d6afc66e1d4b473e9a8e6abf1737b64d/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:33.272828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fecbb-7b7b-4e1f-982d-6acd3ac6d6cf None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:33.272828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fecbb-7b7b-4e1f-982d-6acd3ac6d6cf None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:33.272828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fecbb-7b7b-4e1f-982d-6acd3ac6d6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:33.292544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-934fecbb-7b7b-4e1f-982d-6acd3ac6d6cf None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:33.293814 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-934fecbb-7b7b-4e1f-982d-6acd3ac6d6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:33.354257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1040/2070] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:33.363782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2c786-7397-439e-8255-d83cd600de9a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:33.365506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0ce2c786-7397-439e-8255-d83cd600de9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:33.423555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2c786-7397-439e-8255-d83cd600de9a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:33.427271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf0d1-2ebd-4954-b6f2-cc26f34e034f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:33.427916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf0d1-2ebd-4954-b6f2-cc26f34e034f service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:33.428201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf0d1-2ebd-4954-b6f2-cc26f34e034f service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:33.428479 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf0d1-2ebd-4954-b6f2-cc26f34e034f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:33.438170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf0d1-2ebd-4954-b6f2-cc26f34e034f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:33.439593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf0d1-2ebd-4954-b6f2-cc26f34e034f service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:33.449241 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1031/2071] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:38.073167 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fecbb-7b7b-4e1f-982d-6acd3ac6d6cf None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:38.074677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-934fecbb-7b7b-4e1f-982d-6acd3ac6d6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:38.086204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fecbb-7b7b-4e1f-982d-6acd3ac6d6cf None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:38.091568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:38.092595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:38.092903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:38.093379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] PATH_INFO: `/v3/users/3b930571934b4c8b92891278f8fa0bc5` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:38.094709 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b930571934b4c8b92891278f8fa0bc5)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:38.096796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:38.309376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b930571934b4c8b92891278f8fa0bc5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:38.310037 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b930571934b4c8b92891278f8fa0bc5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:38.310650 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b930571934b4c8b92891278f8fa0bc5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:38.324441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b930571934b4c8b92891278f8fa0bc5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:38.332416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b930571934b4c8b92891278f8fa0bc5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:38.402233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1041/2072] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:38 2022] DELETE /identity/v3/users/3b930571934b4c8b92891278f8fa0bc5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:38.407784 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bc294-7e0f-4269-854b-f4cf641c28fe None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:38.412469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bc294-7e0f-4269-854b-f4cf641c28fe None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:38.412469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bc294-7e0f-4269-854b-f4cf641c28fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:38.429526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-da1bc294-7e0f-4269-854b-f4cf641c28fe None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:38.431123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-da1bc294-7e0f-4269-854b-f4cf641c28fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:38.499735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1032/2073] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:38.511951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:38.517949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:38.596110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c90c0c-01bd-4841-afb8-ff2c6f9b086c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:38.601152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af30dc0-ae35-4c3f-b9d2-ef531060eb59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:38.601949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af30dc0-ae35-4c3f-b9d2-ef531060eb59 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:38.604531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af30dc0-ae35-4c3f-b9d2-ef531060eb59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:38.604531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af30dc0-ae35-4c3f-b9d2-ef531060eb59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:38.619412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af30dc0-ae35-4c3f-b9d2-ef531060eb59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:38.623496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af30dc0-ae35-4c3f-b9d2-ef531060eb59 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:38.648785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1042/2074] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:39.207776 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bc294-7e0f-4269-854b-f4cf641c28fe None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:39.209363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-da1bc294-7e0f-4269-854b-f4cf641c28fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:39.232041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bc294-7e0f-4269-854b-f4cf641c28fe None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:39.241647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:39.243137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:39.243473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:39.243761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] PATH_INFO: `/v3/projects/1bc22d831d114f978dcaa43311f7c6f9` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:39.246235 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc22d831d114f978dcaa43311f7c6f9)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:39.253953 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:39.362480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc22d831d114f978dcaa43311f7c6f9', 'request_id': 'req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:39.368376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc22d831d114f978dcaa43311f7c6f9', 'request_id': 'req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:39.454495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc22d831d114f978dcaa43311f7c6f9', 'request_id': 'req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:39.473917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] The token cache is being invalidate because project 1bc22d831d114f978dcaa43311f7c6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:39.474550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:39.475571 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:39.481554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1033/2075] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:39 2022] DELETE /identity/v3/projects/1bc22d831d114f978dcaa43311f7c6f9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:39.481753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af30dc0-ae35-4c3f-b9d2-ef531060eb59 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:39.500129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af30dc0-ae35-4c3f-b9d2-ef531060eb59 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:39.606965 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:39.609187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:39.609660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:39.610302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] PATH_INFO: `/v3/users/a2cb8d6cde504bb2938c5dc9ac29f7c5` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:39.611383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2cb8d6cde504bb2938c5dc9ac29f7c5)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:39.613661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:39.873598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2cb8d6cde504bb2938c5dc9ac29f7c5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:39.875314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2cb8d6cde504bb2938c5dc9ac29f7c5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:39.876733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2cb8d6cde504bb2938c5dc9ac29f7c5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:39.925109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2cb8d6cde504bb2938c5dc9ac29f7c5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:39.934313 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4f88260a-572f-496d-8a1d-319770dc403e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2cb8d6cde504bb2938c5dc9ac29f7c5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:40.036906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1043/2076] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:39 2022] DELETE /identity/v3/users/a2cb8d6cde504bb2938c5dc9ac29f7c5 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:39:40.742553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:40.744133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:40.794018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f77c7a-b7ce-4929-a918-f0ab126a17dc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:40.902630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:40.904015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:40.904504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:40.905154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] PATH_INFO: `/v3/projects/486e2b7f486b40ea8c26c82a8dc00f36` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:40.907823 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] RBAC: Authorizing `identity:delete_project(project_id=486e2b7f486b40ea8c26c82a8dc00f36)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:40.911863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.085888 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486e2b7f486b40ea8c26c82a8dc00f36', 'request_id': 'req-f1409ec9-c5e7-41a4-b547-2606dd3e711f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:41.092683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486e2b7f486b40ea8c26c82a8dc00f36', 'request_id': 'req-f1409ec9-c5e7-41a4-b547-2606dd3e711f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:41.173528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486e2b7f486b40ea8c26c82a8dc00f36', 'request_id': 'req-f1409ec9-c5e7-41a4-b547-2606dd3e711f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:41.185622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] The token cache is being invalidate because project 486e2b7f486b40ea8c26c82a8dc00f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:41.187996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:41.187996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f1409ec9-c5e7-41a4-b547-2606dd3e711f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:41.189168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1034/2077] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:40 2022] DELETE /identity/v3/projects/486e2b7f486b40ea8c26c82a8dc00f36 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:41.196190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84077-2ddb-420d-abb5-ac8720742643 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.196745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84077-2ddb-420d-abb5-ac8720742643 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.202896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84077-2ddb-420d-abb5-ac8720742643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.222388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-71e84077-2ddb-420d-abb5-ac8720742643 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:41.223613 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-71e84077-2ddb-420d-abb5-ac8720742643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:41.276136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057b7d-700f-4ae8-a0d9-a635a7658acc None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.276627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057b7d-700f-4ae8-a0d9-a635a7658acc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.277070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057b7d-700f-4ae8-a0d9-a635a7658acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.309675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1044/2078] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:41.312404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40415ea5-aee6-45f8-95de-4b1c393ef8c9 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.312692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40415ea5-aee6-45f8-95de-4b1c393ef8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.313155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40415ea5-aee6-45f8-95de-4b1c393ef8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.337034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-40415ea5-aee6-45f8-95de-4b1c393ef8c9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:41.338568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-40415ea5-aee6-45f8-95de-4b1c393ef8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:41.353199 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e0057b7d-700f-4ae8-a0d9-a635a7658acc None None] MFA Rules not processed for user `d6afc66e1d4b473e9a8e6abf1737b64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:41.354705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e0057b7d-700f-4ae8-a0d9-a635a7658acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:41.358773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1045/2079] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:41.363179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40415ea5-aee6-45f8-95de-4b1c393ef8c9 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:41.375610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40415ea5-aee6-45f8-95de-4b1c393ef8c9 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:41.381632 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897de55a-2c97-4dd5-902b-b85fd915a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:41.383359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de55a-2c97-4dd5-902b-b85fd915a00a admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.383817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de55a-2c97-4dd5-902b-b85fd915a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.384242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de55a-2c97-4dd5-902b-b85fd915a00a admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.385182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897de55a-2c97-4dd5-902b-b85fd915a00a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:41.385669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897de55a-2c97-4dd5-902b-b85fd915a00a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:41.388444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897de55a-2c97-4dd5-902b-b85fd915a00a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.407933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1046/2080] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:39:41.413805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897de55a-2c97-4dd5-902b-b85fd915a00a admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:41.454124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897de55a-2c97-4dd5-902b-b85fd915a00a admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:41.467947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f09d2d-f64c-406c-970e-2c8ecc8a9a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:41.472952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1035/2081] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:41.473105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f09d2d-f64c-406c-970e-2c8ecc8a9a53 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.473105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f09d2d-f64c-406c-970e-2c8ecc8a9a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.473105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f09d2d-f64c-406c-970e-2c8ecc8a9a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.475892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f09d2d-f64c-406c-970e-2c8ecc8a9a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:41.480943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f09d2d-f64c-406c-970e-2c8ecc8a9a53 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.481262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0057b7d-700f-4ae8-a0d9-a635a7658acc None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:41.492182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e0057b7d-700f-4ae8-a0d9-a635a7658acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:41.519087 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0057b7d-700f-4ae8-a0d9-a635a7658acc None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:41.525223 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f15fe-35c0-4d2b-9422-cdfa8800aec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:41.526803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f15fe-35c0-4d2b-9422-cdfa8800aec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.527343 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f15fe-35c0-4d2b-9422-cdfa8800aec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.527649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f15fe-35c0-4d2b-9422-cdfa8800aec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.528397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f15fe-35c0-4d2b-9422-cdfa8800aec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:41.530394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f15fe-35c0-4d2b-9422-cdfa8800aec5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.592781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1047/2082] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:41 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:41.597109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f09d2d-f64c-406c-970e-2c8ecc8a9a53 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:41.668406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1036/2083] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:41 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:41.672629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f15fe-35c0-4d2b-9422-cdfa8800aec5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:41.691814 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f09d2d-f64c-406c-970e-2c8ecc8a9a53 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:41.751007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f15fe-35c0-4d2b-9422-cdfa8800aec5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:41.760932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354932-f740-40fa-8f44-ef6cad436b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:41.760932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354932-f740-40fa-8f44-ef6cad436b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.760932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354932-f740-40fa-8f44-ef6cad436b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.760932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354932-f740-40fa-8f44-ef6cad436b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.761255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a354932-f740-40fa-8f44-ef6cad436b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:41.762391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a354932-f740-40fa-8f44-ef6cad436b53 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.783482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03100f9-3e7f-4767-b70d-17d7a17b268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:41.784168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03100f9-3e7f-4767-b70d-17d7a17b268c admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.784451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03100f9-3e7f-4767-b70d-17d7a17b268c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.784729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03100f9-3e7f-4767-b70d-17d7a17b268c admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.785456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03100f9-3e7f-4767-b70d-17d7a17b268c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:41.789547 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03100f9-3e7f-4767-b70d-17d7a17b268c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.854415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1037/2084] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:41 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:41.854927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1048/2085] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:41 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:41.859024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354932-f740-40fa-8f44-ef6cad436b53 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:41.859308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03100f9-3e7f-4767-b70d-17d7a17b268c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:41.870495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354932-f740-40fa-8f44-ef6cad436b53 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:41.873107 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03100f9-3e7f-4767-b70d-17d7a17b268c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:41.877250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61059d-a3c3-4ba2-9e47-e12ed5b4e1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:41.878354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61059d-a3c3-4ba2-9e47-e12ed5b4e1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.878740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61059d-a3c3-4ba2-9e47-e12ed5b4e1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.879117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61059d-a3c3-4ba2-9e47-e12ed5b4e1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.880077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69035e-0377-4126-8673-429ed967683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:41.880205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61059d-a3c3-4ba2-9e47-e12ed5b4e1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:41.880752 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69035e-0377-4126-8673-429ed967683c admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.881039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69035e-0377-4126-8673-429ed967683c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.881362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69035e-0377-4126-8673-429ed967683c admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.882231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69035e-0377-4126-8673-429ed967683c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:41.882740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61059d-a3c3-4ba2-9e47-e12ed5b4e1e9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.883812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69035e-0377-4126-8673-429ed967683c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.893785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1038/2086] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:41.897828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61059d-a3c3-4ba2-9e47-e12ed5b4e1e9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:41.899362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1049/2087] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:41.902572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69035e-0377-4126-8673-429ed967683c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:41.911162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61059d-a3c3-4ba2-9e47-e12ed5b4e1e9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:41.912997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69035e-0377-4126-8673-429ed967683c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:41.916596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dade5a-afdc-4028-9217-d6e0c5b77dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:41.917796 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dade5a-afdc-4028-9217-d6e0c5b77dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.918041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80a59b-2643-409c-ad57-c1ccd5c3ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:41.918472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dade5a-afdc-4028-9217-d6e0c5b77dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.918593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80a59b-2643-409c-ad57-c1ccd5c3ac36 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.918898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80a59b-2643-409c-ad57-c1ccd5c3ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.919143 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dade5a-afdc-4028-9217-d6e0c5b77dca admin admin] PATH_INFO: `/v3/projects/e52be49f7c694968b392e765935d174c/users/121d1f97713b4503a8694cf92405b3d6/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.919241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80a59b-2643-409c-ad57-c1ccd5c3ac36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.920029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80a59b-2643-409c-ad57-c1ccd5c3ac36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:41.922363 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80a59b-2643-409c-ad57-c1ccd5c3ac36 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.937417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1050/2088] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:39:41.939990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80a59b-2643-409c-ad57-c1ccd5c3ac36 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:41.940804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dade5a-afdc-4028-9217-d6e0c5b77dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52be49f7c694968b392e765935d174c, user_id=121d1f97713b4503a8694cf92405b3d6, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:41.943752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dade5a-afdc-4028-9217-d6e0c5b77dca admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.950185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80a59b-2643-409c-ad57-c1ccd5c3ac36 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:41.955003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70020613-9cbc-4b8a-9dfb-8b686ba5a694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:41.955954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020613-9cbc-4b8a-9dfb-8b686ba5a694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:41.956238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020613-9cbc-4b8a-9dfb-8b686ba5a694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:41.956516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020613-9cbc-4b8a-9dfb-8b686ba5a694 admin admin] PATH_INFO: `/v3/projects/0ac2b817fa1d4855980ba8eaa190ac99/users/5f5313c7058b4789b024e241439b7277/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:41.971238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70020613-9cbc-4b8a-9dfb-8b686ba5a694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac2b817fa1d4855980ba8eaa190ac99, user_id=5f5313c7058b4789b024e241439b7277, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:41.974009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70020613-9cbc-4b8a-9dfb-8b686ba5a694 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:41.997346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1039/2089] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:41 2022] PUT /identity/v3/projects/e52be49f7c694968b392e765935d174c/users/121d1f97713b4503a8694cf92405b3d6/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:39:42.002714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dade5a-afdc-4028-9217-d6e0c5b77dca admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:42.049020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1051/2090] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:41 2022] PUT /identity/v3/projects/0ac2b817fa1d4855980ba8eaa190ac99/users/5f5313c7058b4789b024e241439b7277/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:39:42.059928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1999a9-5932-4884-bb25-9d0ec5cee4a1 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:42.060302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1999a9-5932-4884-bb25-9d0ec5cee4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:42.060667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1999a9-5932-4884-bb25-9d0ec5cee4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:42.075906 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dade5a-afdc-4028-9217-d6e0c5b77dca admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:42.088799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5f1999a9-5932-4884-bb25-9d0ec5cee4a1 None None] MFA Rules not processed for user `5f5313c7058b4789b024e241439b7277`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:42.090137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5f1999a9-5932-4884-bb25-9d0ec5cee4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:42.139306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06458948-3331-4355-9a5e-3b307df21c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:42.140671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06458948-3331-4355-9a5e-3b307df21c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:42.140964 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06458948-3331-4355-9a5e-3b307df21c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:42.141441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06458948-3331-4355-9a5e-3b307df21c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:42.142178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06458948-3331-4355-9a5e-3b307df21c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:42.143685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06458948-3331-4355-9a5e-3b307df21c8d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:42.159155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1040/2091] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:39:42.162196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06458948-3331-4355-9a5e-3b307df21c8d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:42.163026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1052/2092] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:42.174262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06458948-3331-4355-9a5e-3b307df21c8d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:42.174523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1999a9-5932-4884-bb25-9d0ec5cee4a1 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:42.179360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca183136-b4d8-49f3-8296-e9bb9ba94736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:42.180490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca183136-b4d8-49f3-8296-e9bb9ba94736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:42.180869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca183136-b4d8-49f3-8296-e9bb9ba94736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:42.181314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca183136-b4d8-49f3-8296-e9bb9ba94736 admin admin] PATH_INFO: `/v3/projects/e52be49f7c694968b392e765935d174c/users/121d1f97713b4503a8694cf92405b3d6/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:42.184720 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca183136-b4d8-49f3-8296-e9bb9ba94736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52be49f7c694968b392e765935d174c, user_id=121d1f97713b4503a8694cf92405b3d6, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:42.188086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1999a9-5932-4884-bb25-9d0ec5cee4a1 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:42.188255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca183136-b4d8-49f3-8296-e9bb9ba94736 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:42.194304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcdd5c-bd6c-48c7-b928-af976692b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:42.195411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcdd5c-bd6c-48c7-b928-af976692b363 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:42.195819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcdd5c-bd6c-48c7-b928-af976692b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:42.196101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcdd5c-bd6c-48c7-b928-af976692b363 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:42.197091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcdd5c-bd6c-48c7-b928-af976692b363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:42.199320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcdd5c-bd6c-48c7-b928-af976692b363 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:42.199442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1041/2093] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:42 2022] PUT /identity/v3/projects/e52be49f7c694968b392e765935d174c/users/121d1f97713b4503a8694cf92405b3d6/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:39:42.314695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1053/2094] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:42 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:42.318401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca183136-b4d8-49f3-8296-e9bb9ba94736 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:42.399860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca183136-b4d8-49f3-8296-e9bb9ba94736 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:42.461735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9b1b6-dde5-4f7f-8892-941b9c929d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:42.462491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9b1b6-dde5-4f7f-8892-941b9c929d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:42.465058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9b1b6-dde5-4f7f-8892-941b9c929d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:42.465058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9b1b6-dde5-4f7f-8892-941b9c929d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:42.465058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9b1b6-dde5-4f7f-8892-941b9c929d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:42.465852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9b1b6-dde5-4f7f-8892-941b9c929d67 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:42.541516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1042/2095] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:42 2022] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:42.545436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcdd5c-bd6c-48c7-b928-af976692b363 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:42.563905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcdd5c-bd6c-48c7-b928-af976692b363 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:42.569489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176022-6ee3-4ba3-8d8b-3c3085876c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:42.570432 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176022-6ee3-4ba3-8d8b-3c3085876c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:42.570895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176022-6ee3-4ba3-8d8b-3c3085876c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:42.571276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176022-6ee3-4ba3-8d8b-3c3085876c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:42.572171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176022-6ee3-4ba3-8d8b-3c3085876c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:42.573970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176022-6ee3-4ba3-8d8b-3c3085876c1b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:42.594884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1054/2096] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:42.600396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9b1b6-dde5-4f7f-8892-941b9c929d67 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:42.623861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9b1b6-dde5-4f7f-8892-941b9c929d67 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:42.635377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217429ba-30bc-4c1e-95ec-b389369475a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:42.637194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217429ba-30bc-4c1e-95ec-b389369475a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:42.637807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217429ba-30bc-4c1e-95ec-b389369475a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:42.638410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217429ba-30bc-4c1e-95ec-b389369475a0 admin admin] PATH_INFO: `/v3/projects/bd26795419934af08de3a4f67acd276b/users/eef09cc7dae14810840a9d7854c0377d/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:42.672984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217429ba-30bc-4c1e-95ec-b389369475a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd26795419934af08de3a4f67acd276b, user_id=eef09cc7dae14810840a9d7854c0377d, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:42.682656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217429ba-30bc-4c1e-95ec-b389369475a0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:42.794678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1043/2097] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:42 2022] PUT /identity/v3/projects/bd26795419934af08de3a4f67acd276b/users/eef09cc7dae14810840a9d7854c0377d/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:39:42.800902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176022-6ee3-4ba3-8d8b-3c3085876c1b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:42.811449 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176022-6ee3-4ba3-8d8b-3c3085876c1b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:42.872589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aabfe-2562-4825-b110-4e652c3264f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:42.875523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aabfe-2562-4825-b110-4e652c3264f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:42.875523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aabfe-2562-4825-b110-4e652c3264f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:42.875523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aabfe-2562-4825-b110-4e652c3264f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:42.875523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194aabfe-2562-4825-b110-4e652c3264f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:42.877066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194aabfe-2562-4825-b110-4e652c3264f1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:42.891220 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1055/2098] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:42.894969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217429ba-30bc-4c1e-95ec-b389369475a0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:42.906744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217429ba-30bc-4c1e-95ec-b389369475a0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:42.912786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae0332-a729-4301-80cf-c02c582d10e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:42.913972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae0332-a729-4301-80cf-c02c582d10e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:42.914567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae0332-a729-4301-80cf-c02c582d10e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:42.915396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae0332-a729-4301-80cf-c02c582d10e5 admin admin] PATH_INFO: `/v3/projects/bd26795419934af08de3a4f67acd276b/users/eef09cc7dae14810840a9d7854c0377d/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:42.917582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae0332-a729-4301-80cf-c02c582d10e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd26795419934af08de3a4f67acd276b, user_id=eef09cc7dae14810840a9d7854c0377d, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:42.920601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae0332-a729-4301-80cf-c02c582d10e5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:42.933055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1044/2099] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:42 2022] PUT /identity/v3/projects/bd26795419934af08de3a4f67acd276b/users/eef09cc7dae14810840a9d7854c0377d/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:39:42.943982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5174-4167-47e4-ad15-d25e910e5f5d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:42.944191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5174-4167-47e4-ad15-d25e910e5f5d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:42.944486 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5174-4167-47e4-ad15-d25e910e5f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:42.989655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-84ad5174-4167-47e4-ad15-d25e910e5f5d None None] MFA Rules not processed for user `eef09cc7dae14810840a9d7854c0377d`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:42.990971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-84ad5174-4167-47e4-ad15-d25e910e5f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:43.095298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1056/2100] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:43.110227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae0332-a729-4301-80cf-c02c582d10e5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:43.112408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ceae0332-a729-4301-80cf-c02c582d10e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:43.193088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae0332-a729-4301-80cf-c02c582d10e5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:43.202135 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57d153-eba9-416a-9bf9-2e814e443f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:43.203469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57d153-eba9-416a-9bf9-2e814e443f89 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:43.203837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57d153-eba9-416a-9bf9-2e814e443f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:43.204194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57d153-eba9-416a-9bf9-2e814e443f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:43.214880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57d153-eba9-416a-9bf9-2e814e443f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:43.216535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57d153-eba9-416a-9bf9-2e814e443f89 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:43.238641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1045/2101] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:43.268800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad5174-4167-47e4-ad15-d25e910e5f5d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:43.376436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad5174-4167-47e4-ad15-d25e910e5f5d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:43.382301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:43.383670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:43.384035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:43.384533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] PATH_INFO: `/v3/users/5f5313c7058b4789b024e241439b7277` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:43.386025 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5313c7058b4789b024e241439b7277)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:43.388143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:43.604339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5313c7058b4789b024e241439b7277'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:43.605013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5313c7058b4789b024e241439b7277'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:43.605690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5313c7058b4789b024e241439b7277'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:43.617483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5313c7058b4789b024e241439b7277'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:43.624817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5313c7058b4789b024e241439b7277'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:43.734440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1057/2102] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:43 2022] DELETE /identity/v3/users/5f5313c7058b4789b024e241439b7277 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:43.739553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5fe9-bbc6-46ad-ab52-087d098de359 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:43.739856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5fe9-bbc6-46ad-ab52-087d098de359 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:43.740224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5fe9-bbc6-46ad-ab52-087d098de359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:43.764320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-772e5fe9-bbc6-46ad-ab52-087d098de359 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:43.766518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-772e5fe9-bbc6-46ad-ab52-087d098de359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:43.838689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1046/2103] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:43.884663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:43.886669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:43.968787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b2a0a-83a0-4bc5-86f9-f7cc35eec1d9 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:43.974372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2992d9-b007-4c77-a23b-1872db6be253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:43.975461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2992d9-b007-4c77-a23b-1872db6be253 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:43.975816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2992d9-b007-4c77-a23b-1872db6be253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:43.976147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2992d9-b007-4c77-a23b-1872db6be253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:43.989711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2992d9-b007-4c77-a23b-1872db6be253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:43.991565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2992d9-b007-4c77-a23b-1872db6be253 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:44.007832 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1058/2104] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:44.985993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e5fe9-bbc6-46ad-ab52-087d098de359 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:44.988176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-772e5fe9-bbc6-46ad-ab52-087d098de359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:45.092171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e5fe9-bbc6-46ad-ab52-087d098de359 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:45.106034 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:45.110894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:45.111843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:45.112191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] PATH_INFO: `/v3/projects/0ac2b817fa1d4855980ba8eaa190ac99` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:45.116044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac2b817fa1d4855980ba8eaa190ac99)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:45.121251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:45.298781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac2b817fa1d4855980ba8eaa190ac99', 'request_id': 'req-c627017d-6d1c-4014-9840-6155b89858f8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:45.325364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac2b817fa1d4855980ba8eaa190ac99', 'request_id': 'req-c627017d-6d1c-4014-9840-6155b89858f8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:45.425717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac2b817fa1d4855980ba8eaa190ac99', 'request_id': 'req-c627017d-6d1c-4014-9840-6155b89858f8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:45.448110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] The token cache is being invalidate because project 0ac2b817fa1d4855980ba8eaa190ac99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:45.448651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:45.449645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:45.451680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1047/2105] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:44 2022] DELETE /identity/v3/projects/0ac2b817fa1d4855980ba8eaa190ac99 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:45.456036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2992d9-b007-4c77-a23b-1872db6be253 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:45.529050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2992d9-b007-4c77-a23b-1872db6be253 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:45.618293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:45.620358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:45.620972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:45.621468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] PATH_INFO: `/v3/users/eef09cc7dae14810840a9d7854c0377d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:45.623284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef09cc7dae14810840a9d7854c0377d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:45.645631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:45.954951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef09cc7dae14810840a9d7854c0377d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:45.955673 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef09cc7dae14810840a9d7854c0377d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:45.956342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef09cc7dae14810840a9d7854c0377d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:45.970507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef09cc7dae14810840a9d7854c0377d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:45.981446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e25bb143-f220-431b-a06c-0eccbf7412b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef09cc7dae14810840a9d7854c0377d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:46.071576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1059/2106] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:45 2022] DELETE /identity/v3/users/eef09cc7dae14810840a9d7854c0377d => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:46.585091 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:46.587801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:46.621649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627017d-6d1c-4014-9840-6155b89858f8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:46.706186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:46.707319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:46.707783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:46.708239 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] PATH_INFO: `/v3/projects/bd26795419934af08de3a4f67acd276b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:46.709891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd26795419934af08de3a4f67acd276b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:46.711955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:46.866700 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd26795419934af08de3a4f67acd276b', 'request_id': 'req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:46.872751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd26795419934af08de3a4f67acd276b', 'request_id': 'req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:46.936104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd26795419934af08de3a4f67acd276b', 'request_id': 'req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:46.956526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] The token cache is being invalidate because project bd26795419934af08de3a4f67acd276b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:46.957447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:46.958297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6fc862fd-4e39-43dc-8bef-d3ff21e526c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:46.961848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1048/2107] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:46 2022] DELETE /identity/v3/projects/bd26795419934af08de3a4f67acd276b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:46.967136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fd3ea-445d-42a6-9128-a024b6136641 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:46.967136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fd3ea-445d-42a6-9128-a024b6136641 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:46.967793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fd3ea-445d-42a6-9128-a024b6136641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:47.012306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-793fd3ea-445d-42a6-9128-a024b6136641 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:47.013671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-793fd3ea-445d-42a6-9128-a024b6136641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:47.095642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1060/2108] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:47.103485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a906a-4e31-4e4c-bf59-6ae1b8f32e3e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:47.103902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a906a-4e31-4e4c-bf59-6ae1b8f32e3e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:47.104275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a906a-4e31-4e4c-bf59-6ae1b8f32e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:47.125703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8f6a906a-4e31-4e4c-bf59-6ae1b8f32e3e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:47.128882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8f6a906a-4e31-4e4c-bf59-6ae1b8f32e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:47.153192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1049/2109] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:47.154561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fd3ea-445d-42a6-9128-a024b6136641 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:47.173515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fd3ea-445d-42a6-9128-a024b6136641 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:47.179027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92964cd1-f1d5-468b-a3e8-6c342ea3e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:47.181084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92964cd1-f1d5-468b-a3e8-6c342ea3e62c admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:47.181570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92964cd1-f1d5-468b-a3e8-6c342ea3e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:47.186492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92964cd1-f1d5-468b-a3e8-6c342ea3e62c admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:47.186492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92964cd1-f1d5-468b-a3e8-6c342ea3e62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:47.186492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92964cd1-f1d5-468b-a3e8-6c342ea3e62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:47.186492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92964cd1-f1d5-468b-a3e8-6c342ea3e62c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:47.199131 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1061/2110] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:39:47.204506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a906a-4e31-4e4c-bf59-6ae1b8f32e3e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:47.217061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a906a-4e31-4e4c-bf59-6ae1b8f32e3e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:47.232104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a1f41-740d-4985-8c17-23fb89ba4c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:47.232768 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a1f41-740d-4985-8c17-23fb89ba4c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:47.233054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a1f41-740d-4985-8c17-23fb89ba4c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:47.233393 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a1f41-740d-4985-8c17-23fb89ba4c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:47.234184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a1f41-740d-4985-8c17-23fb89ba4c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:47.240808 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a1f41-740d-4985-8c17-23fb89ba4c34 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:47.361324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1050/2111] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:47 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:47.365101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92964cd1-f1d5-468b-a3e8-6c342ea3e62c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:47.381667 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92964cd1-f1d5-468b-a3e8-6c342ea3e62c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:47.590587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436fbbd-85dd-46ee-a3f1-b459e887779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:47.591469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436fbbd-85dd-46ee-a3f1-b459e887779f admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:47.591595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436fbbd-85dd-46ee-a3f1-b459e887779f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:47.591851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436fbbd-85dd-46ee-a3f1-b459e887779f admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:47.592642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436fbbd-85dd-46ee-a3f1-b459e887779f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:47.596971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436fbbd-85dd-46ee-a3f1-b459e887779f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:47.700113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1062/2112] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:47 2022] POST /identity/v3/users => generated 295 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:47.707783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a1f41-740d-4985-8c17-23fb89ba4c34 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:47.721741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a1f41-740d-4985-8c17-23fb89ba4c34 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:47.737563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51aa61b-16d6-4b26-9726-c80a7c661a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:47.738840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aa61b-16d6-4b26-9726-c80a7c661a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:47.740656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aa61b-16d6-4b26-9726-c80a7c661a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:47.741248 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aa61b-16d6-4b26-9726-c80a7c661a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:47.742312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51aa61b-16d6-4b26-9726-c80a7c661a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:47.747314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51aa61b-16d6-4b26-9726-c80a7c661a69 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:47.779877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1051/2113] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:47.784159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436fbbd-85dd-46ee-a3f1-b459e887779f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:47.798119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436fbbd-85dd-46ee-a3f1-b459e887779f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:47.811018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24c2dd-2c9b-40b2-b7b5-6742974ae536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:47.813987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24c2dd-2c9b-40b2-b7b5-6742974ae536 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:47.814383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24c2dd-2c9b-40b2-b7b5-6742974ae536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:47.817365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24c2dd-2c9b-40b2-b7b5-6742974ae536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:47.818695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24c2dd-2c9b-40b2-b7b5-6742974ae536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:47.820468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24c2dd-2c9b-40b2-b7b5-6742974ae536 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:47.854261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1063/2114] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:47.855641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51aa61b-16d6-4b26-9726-c80a7c661a69 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:47.870242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51aa61b-16d6-4b26-9726-c80a7c661a69 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:47.886432 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36f316-370a-434a-8a90-13890dc29627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:47.889463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36f316-370a-434a-8a90-13890dc29627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:47.889955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36f316-370a-434a-8a90-13890dc29627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:47.891253 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36f316-370a-434a-8a90-13890dc29627 admin admin] PATH_INFO: `/v3/projects/9e6b96ad830b4822af079e9e5f479b70/users/c5e8f4a68d4e430598bd1c09fa367d43/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:47.930439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36f316-370a-434a-8a90-13890dc29627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6b96ad830b4822af079e9e5f479b70, user_id=c5e8f4a68d4e430598bd1c09fa367d43, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:47.934330 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36f316-370a-434a-8a90-13890dc29627 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:48.038382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1052/2115] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:47 2022] PUT /identity/v3/projects/9e6b96ad830b4822af079e9e5f479b70/users/c5e8f4a68d4e430598bd1c09fa367d43/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:48.050239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4970b8-0248-4a37-a733-8d33df5f80e5 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:48.050881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4970b8-0248-4a37-a733-8d33df5f80e5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:48.050881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4970b8-0248-4a37-a733-8d33df5f80e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:48.086005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-0b4970b8-0248-4a37-a733-8d33df5f80e5 None None] MFA Rules not processed for user `c5e8f4a68d4e430598bd1c09fa367d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:48.087639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0b4970b8-0248-4a37-a733-8d33df5f80e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:48.166146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1064/2116] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:48.170309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36f316-370a-434a-8a90-13890dc29627 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:48.271544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36f316-370a-434a-8a90-13890dc29627 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:48.277868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adcd2f-1fb2-4f54-91ae-f8c96162d9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:48.280962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adcd2f-1fb2-4f54-91ae-f8c96162d9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:48.280962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adcd2f-1fb2-4f54-91ae-f8c96162d9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:48.280962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adcd2f-1fb2-4f54-91ae-f8c96162d9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:48.280962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adcd2f-1fb2-4f54-91ae-f8c96162d9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:48.283513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3adcd2f-1fb2-4f54-91ae-f8c96162d9b0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:48.427398 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4970b8-0248-4a37-a733-8d33df5f80e5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:48.427998 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1053/2117] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:48 2022] POST /identity/v3/projects => generated 387 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:48.448958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4970b8-0248-4a37-a733-8d33df5f80e5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:48.555072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbd993-e3ee-40c4-ade5-6558ed4cbd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:48.558142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbd993-e3ee-40c4-ade5-6558ed4cbd41 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:48.558142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbd993-e3ee-40c4-ade5-6558ed4cbd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:48.558142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbd993-e3ee-40c4-ade5-6558ed4cbd41 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:48.558142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbd993-e3ee-40c4-ade5-6558ed4cbd41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:48.559445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbd993-e3ee-40c4-ade5-6558ed4cbd41 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:48.639089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1065/2118] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:48 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:48.643784 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adcd2f-1fb2-4f54-91ae-f8c96162d9b0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:48.657468 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adcd2f-1fb2-4f54-91ae-f8c96162d9b0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:48.670047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765480-185b-486e-a24a-a3ca32d757ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:48.671482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765480-185b-486e-a24a-a3ca32d757ca admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:48.671870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765480-185b-486e-a24a-a3ca32d757ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:48.675096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765480-185b-486e-a24a-a3ca32d757ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:48.679131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59765480-185b-486e-a24a-a3ca32d757ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:48.679131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59765480-185b-486e-a24a-a3ca32d757ca admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:48.704409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1054/2119] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:48.709055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbd993-e3ee-40c4-ade5-6558ed4cbd41 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:48.723293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbd993-e3ee-40c4-ade5-6558ed4cbd41 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:48.735328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f872b-7ed2-4667-bb6d-13f540e025e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:48.736606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f872b-7ed2-4667-bb6d-13f540e025e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:48.736910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f872b-7ed2-4667-bb6d-13f540e025e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:48.737348 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f872b-7ed2-4667-bb6d-13f540e025e4 admin admin] PATH_INFO: `/v3/projects/5a88c3aa51264046ade4ec43d73802c5/users/330dd012f1db4bfda4714e43082f4364/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:48.765121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f872b-7ed2-4667-bb6d-13f540e025e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a88c3aa51264046ade4ec43d73802c5, user_id=330dd012f1db4bfda4714e43082f4364, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:48.768729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f872b-7ed2-4667-bb6d-13f540e025e4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:48.871637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1066/2120] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:48 2022] PUT /identity/v3/projects/5a88c3aa51264046ade4ec43d73802c5/users/330dd012f1db4bfda4714e43082f4364/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:48.876408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765480-185b-486e-a24a-a3ca32d757ca admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:48.887145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765480-185b-486e-a24a-a3ca32d757ca admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:49.003865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89519ddc-bf52-4d92-8ee6-1d9bfa7410a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:49.004570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89519ddc-bf52-4d92-8ee6-1d9bfa7410a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:49.004861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89519ddc-bf52-4d92-8ee6-1d9bfa7410a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:49.005770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89519ddc-bf52-4d92-8ee6-1d9bfa7410a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:49.006571 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89519ddc-bf52-4d92-8ee6-1d9bfa7410a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:49.008263 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89519ddc-bf52-4d92-8ee6-1d9bfa7410a5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:49.040989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f872b-7ed2-4667-bb6d-13f540e025e4 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:49.041429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1055/2121] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:49.051895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f872b-7ed2-4667-bb6d-13f540e025e4 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:49.062694 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e067212-ec3f-4f12-b644-92c617773251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:49.064130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067212-ec3f-4f12-b644-92c617773251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:49.064584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067212-ec3f-4f12-b644-92c617773251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:49.065093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067212-ec3f-4f12-b644-92c617773251 admin admin] PATH_INFO: `/v3/projects/5a88c3aa51264046ade4ec43d73802c5/users/330dd012f1db4bfda4714e43082f4364/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:49.067562 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e067212-ec3f-4f12-b644-92c617773251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a88c3aa51264046ade4ec43d73802c5, user_id=330dd012f1db4bfda4714e43082f4364, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:49.070731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e067212-ec3f-4f12-b644-92c617773251 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:49.107495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a400e-f476-4b39-9646-b109d797d498 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:49.107495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a400e-f476-4b39-9646-b109d797d498 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:49.107495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a400e-f476-4b39-9646-b109d797d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:49.107855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1067/2122] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:49 2022] PUT /identity/v3/projects/5a88c3aa51264046ade4ec43d73802c5/users/330dd012f1db4bfda4714e43082f4364/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:49.133962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-608a400e-f476-4b39-9646-b109d797d498 None None] MFA Rules not processed for user `330dd012f1db4bfda4714e43082f4364`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:49.136012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-608a400e-f476-4b39-9646-b109d797d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:49.261370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1056/2123] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:49.273750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e067212-ec3f-4f12-b644-92c617773251 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:49.275997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4e067212-ec3f-4f12-b644-92c617773251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:49.449458 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e067212-ec3f-4f12-b644-92c617773251 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:49.458481 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825611e-42fd-48d8-adaf-4ed9d9294f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:49.459119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825611e-42fd-48d8-adaf-4ed9d9294f5b service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:49.459474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825611e-42fd-48d8-adaf-4ed9d9294f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:49.459834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825611e-42fd-48d8-adaf-4ed9d9294f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:49.503892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825611e-42fd-48d8-adaf-4ed9d9294f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:49.506880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825611e-42fd-48d8-adaf-4ed9d9294f5b service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:49.563764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1068/2124] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:49.869163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a400e-f476-4b39-9646-b109d797d498 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:49.991990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a400e-f476-4b39-9646-b109d797d498 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:49.996901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:49.997906 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:49.998276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:49.998625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] PATH_INFO: `/v3/users/c5e8f4a68d4e430598bd1c09fa367d43` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:50.000179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e8f4a68d4e430598bd1c09fa367d43)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:50.002384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:50.267334 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e8f4a68d4e430598bd1c09fa367d43'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:50.280944 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e8f4a68d4e430598bd1c09fa367d43'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:50.284867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e8f4a68d4e430598bd1c09fa367d43'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:50.360966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e8f4a68d4e430598bd1c09fa367d43'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:50.380063 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e8f4a68d4e430598bd1c09fa367d43'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:50.398525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1057/2125] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:49 2022] DELETE /identity/v3/users/c5e8f4a68d4e430598bd1c09fa367d43 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:50.410271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcc006-da3d-4f34-b037-ecdd8b76e80f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:50.410271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcc006-da3d-4f34-b037-ecdd8b76e80f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:50.410271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcc006-da3d-4f34-b037-ecdd8b76e80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:50.426452 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-63bcc006-da3d-4f34-b037-ecdd8b76e80f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:50.427892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-63bcc006-da3d-4f34-b037-ecdd8b76e80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:50.501011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1069/2126] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:50.516809 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:50.518371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:50.593094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dced8-5550-41e1-8f25-e21c27034bef None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:50.593739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dced8-5550-41e1-8f25-e21c27034bef None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:50.594030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dced8-5550-41e1-8f25-e21c27034bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:50.640701 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f96dced8-5550-41e1-8f25-e21c27034bef None None] MFA Rules not processed for user `121d1f97713b4503a8694cf92405b3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:50.642149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f96dced8-5550-41e1-8f25-e21c27034bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:50.687742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253d918-bb60-491c-9198-40cda51d74eb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:50.691661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b113d-3e3d-4904-9ba9-306689b5c808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:50.692417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b113d-3e3d-4904-9ba9-306689b5c808 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:50.692774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b113d-3e3d-4904-9ba9-306689b5c808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:50.693131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b113d-3e3d-4904-9ba9-306689b5c808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:50.706120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b113d-3e3d-4904-9ba9-306689b5c808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:50.707578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b113d-3e3d-4904-9ba9-306689b5c808 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:50.733914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1058/2127] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:50.746438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1070/2128] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:50.761150 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b113d-3e3d-4904-9ba9-306689b5c808 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:50.762604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-499b113d-3e3d-4904-9ba9-306689b5c808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:50.825675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b113d-3e3d-4904-9ba9-306689b5c808 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:50.829882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38143626-2fc8-4432-a1ce-7ce3491448f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f8ec4765e05461a98b3c9eb1d3ced5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:50.830540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38143626-2fc8-4432-a1ce-7ce3491448f3 service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:50.830825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38143626-2fc8-4432-a1ce-7ce3491448f3 service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:50.831107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38143626-2fc8-4432-a1ce-7ce3491448f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:50.832936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-38143626-2fc8-4432-a1ce-7ce3491448f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:50.900495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38143626-2fc8-4432-a1ce-7ce3491448f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:50.901970 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38143626-2fc8-4432-a1ce-7ce3491448f3 service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:50.911472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1059/2129] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:39:51.245434 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dced8-5550-41e1-8f25-e21c27034bef None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:51.247011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f96dced8-5550-41e1-8f25-e21c27034bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:51.286002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dced8-5550-41e1-8f25-e21c27034bef None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:51.296436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:51.298246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:51.299240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:51.299832 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] PATH_INFO: `/v3/projects/9e6b96ad830b4822af079e9e5f479b70` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:51.304352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6b96ad830b4822af079e9e5f479b70)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:51.310451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:51.412999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920555-7c45-4f2d-bd36-644778ce621d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:51.413882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920555-7c45-4f2d-bd36-644778ce621d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:51.415679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920555-7c45-4f2d-bd36-644778ce621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:51.440735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-47920555-7c45-4f2d-bd36-644778ce621d None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:51.444631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-47920555-7c45-4f2d-bd36-644778ce621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:51.517028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1060/2130] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:39:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:51.569172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6b96ad830b4822af079e9e5f479b70', 'request_id': 'req-ff1380ce-4189-4cfb-b531-27397e2a29d7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:51.582892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6b96ad830b4822af079e9e5f479b70', 'request_id': 'req-ff1380ce-4189-4cfb-b531-27397e2a29d7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:51.596415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47920555-7c45-4f2d-bd36-644778ce621d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:51.598323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-47920555-7c45-4f2d-bd36-644778ce621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:51.651759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6b96ad830b4822af079e9e5f479b70', 'request_id': 'req-ff1380ce-4189-4cfb-b531-27397e2a29d7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:51.672968 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] The token cache is being invalidate because project 9e6b96ad830b4822af079e9e5f479b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:51.673351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:51.675200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:51.679658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1071/2131] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:51 2022] DELETE /identity/v3/projects/9e6b96ad830b4822af079e9e5f479b70 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:51.683877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:51.687855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:51.746892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47920555-7c45-4f2d-bd36-644778ce621d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:51.813577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1380ce-4189-4cfb-b531-27397e2a29d7 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:51.821711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:51.822930 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:51.823857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:51.824471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] PATH_INFO: `/v3/users/330dd012f1db4bfda4714e43082f4364` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:51.828388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=330dd012f1db4bfda4714e43082f4364)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:51.835709 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:51.894265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bc60e-db9e-4d73-a5df-f8035c0c83ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:51.895820 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bc60e-db9e-4d73-a5df-f8035c0c83ab service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:51.896255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bc60e-db9e-4d73-a5df-f8035c0c83ab service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:51.896715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bc60e-db9e-4d73-a5df-f8035c0c83ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:51.899371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a67bc60e-db9e-4d73-a5df-f8035c0c83ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:51.995190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bc60e-db9e-4d73-a5df-f8035c0c83ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:51.997939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bc60e-db9e-4d73-a5df-f8035c0c83ab service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:52.015725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1061/2132] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 20:39:52.084558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330dd012f1db4bfda4714e43082f4364'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:52.085648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330dd012f1db4bfda4714e43082f4364'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:52.086904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330dd012f1db4bfda4714e43082f4364'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:52.102011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330dd012f1db4bfda4714e43082f4364'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:52.111026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330dd012f1db4bfda4714e43082f4364'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:52.198052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1072/2133] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:39:51 2022] DELETE /identity/v3/users/330dd012f1db4bfda4714e43082f4364 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:52.554356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eebe9e-7114-482a-b513-39950cb1068b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:52.554863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eebe9e-7114-482a-b513-39950cb1068b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:52.555174 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eebe9e-7114-482a-b513-39950cb1068b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:52.591664 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-04eebe9e-7114-482a-b513-39950cb1068b None None] MFA Rules not processed for user `eb3a1cc28fbe48b18d0fd19415cd7a53`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:52.594916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-04eebe9e-7114-482a-b513-39950cb1068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:52.740987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1062/2134] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:52.821411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:52.823671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:52.975613 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2331a1-152d-461f-b598-f5910fade0fc admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:52.997703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:52.999412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:53.004715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:53.006143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] PATH_INFO: `/v3/projects/5a88c3aa51264046ade4ec43d73802c5` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:53.012292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a88c3aa51264046ade4ec43d73802c5)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:53.016883 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:53.223955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a88c3aa51264046ade4ec43d73802c5', 'request_id': 'req-e3823126-60a3-4330-9160-4d5dbbc39ae3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:53.266653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a88c3aa51264046ade4ec43d73802c5', 'request_id': 'req-e3823126-60a3-4330-9160-4d5dbbc39ae3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:53.794441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a88c3aa51264046ade4ec43d73802c5', 'request_id': 'req-e3823126-60a3-4330-9160-4d5dbbc39ae3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:53.816181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] The token cache is being invalidate because project 5a88c3aa51264046ade4ec43d73802c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:39:53.816788 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:53.817781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e3823126-60a3-4330-9160-4d5dbbc39ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:39:53.820219 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1073/2135] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:39:52 2022] DELETE /identity/v3/projects/5a88c3aa51264046ade4ec43d73802c5 => generated 0 bytes in 999 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:53.825310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73829219-9ad4-444d-9095-56914f0bd01d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:53.826410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73829219-9ad4-444d-9095-56914f0bd01d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:53.826950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73829219-9ad4-444d-9095-56914f0bd01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:53.869265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-73829219-9ad4-444d-9095-56914f0bd01d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:53.870683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-73829219-9ad4-444d-9095-56914f0bd01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:54.020464 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1063/2136] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:54.021918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54589c-1155-4745-8c91-bf059a070946 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:54.022425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54589c-1155-4745-8c91-bf059a070946 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:54.022517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54589c-1155-4745-8c91-bf059a070946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:54.070659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-6e54589c-1155-4745-8c91-bf059a070946 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:54.071908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6e54589c-1155-4745-8c91-bf059a070946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:54.094659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1074/2137] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:39:54.100242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73829219-9ad4-444d-9095-56914f0bd01d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:54.118977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73829219-9ad4-444d-9095-56914f0bd01d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:54.145055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19e9a6-f46d-4457-ab14-5856bf5f54c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:54.145941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19e9a6-f46d-4457-ab14-5856bf5f54c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:54.146420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19e9a6-f46d-4457-ab14-5856bf5f54c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:54.146860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19e9a6-f46d-4457-ab14-5856bf5f54c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:54.147774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19e9a6-f46d-4457-ab14-5856bf5f54c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:39:54.148246 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19e9a6-f46d-4457-ab14-5856bf5f54c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:54.150115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19e9a6-f46d-4457-ab14-5856bf5f54c9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:54.198612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1064/2138] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:39:54.207716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54589c-1155-4745-8c91-bf059a070946 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:54.222231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54589c-1155-4745-8c91-bf059a070946 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:54.232521 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835ba73-4376-4d9e-b05c-137e634a632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:54.240804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835ba73-4376-4d9e-b05c-137e634a632d admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:54.241349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835ba73-4376-4d9e-b05c-137e634a632d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:54.242044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835ba73-4376-4d9e-b05c-137e634a632d admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:54.243066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835ba73-4376-4d9e-b05c-137e634a632d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:54.245257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835ba73-4376-4d9e-b05c-137e634a632d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:54.388736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1075/2139] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:54 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:54.392707 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19e9a6-f46d-4457-ab14-5856bf5f54c9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:54.408842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19e9a6-f46d-4457-ab14-5856bf5f54c9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:54.508074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a53386-01d3-4f3c-ab16-eb81245b279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:54.508908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a53386-01d3-4f3c-ab16-eb81245b279b admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:54.509198 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a53386-01d3-4f3c-ab16-eb81245b279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:54.509489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a53386-01d3-4f3c-ab16-eb81245b279b admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:54.510289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a53386-01d3-4f3c-ab16-eb81245b279b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:54.512745 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a53386-01d3-4f3c-ab16-eb81245b279b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:54.687309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1065/2140] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:54 2022] POST /identity/v3/users => generated 288 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:54.688592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835ba73-4376-4d9e-b05c-137e634a632d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:54.702856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835ba73-4376-4d9e-b05c-137e634a632d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:54.710335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574793c0-7c4f-42be-a10a-0082dfc9a75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:54.711096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574793c0-7c4f-42be-a10a-0082dfc9a75d admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:54.711898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574793c0-7c4f-42be-a10a-0082dfc9a75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:54.712223 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574793c0-7c4f-42be-a10a-0082dfc9a75d admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:54.713525 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574793c0-7c4f-42be-a10a-0082dfc9a75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:54.715787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574793c0-7c4f-42be-a10a-0082dfc9a75d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:54.741916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1076/2141] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:54.744977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a53386-01d3-4f3c-ab16-eb81245b279b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:54.774694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a53386-01d3-4f3c-ab16-eb81245b279b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:54.788280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ee630-3bba-4f9f-96b1-898b4caff53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:54.789032 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ee630-3bba-4f9f-96b1-898b4caff53f admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:54.789298 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ee630-3bba-4f9f-96b1-898b4caff53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:54.789571 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ee630-3bba-4f9f-96b1-898b4caff53f admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:54.790313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ee630-3bba-4f9f-96b1-898b4caff53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:54.791976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ee630-3bba-4f9f-96b1-898b4caff53f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:54.824434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1066/2142] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:54.824852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574793c0-7c4f-42be-a10a-0082dfc9a75d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:54.845382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574793c0-7c4f-42be-a10a-0082dfc9a75d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:54.875776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec138d8e-8f69-4c18-93e1-df423a134a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:54.875776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec138d8e-8f69-4c18-93e1-df423a134a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:54.875776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec138d8e-8f69-4c18-93e1-df423a134a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:54.875776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec138d8e-8f69-4c18-93e1-df423a134a84 admin admin] PATH_INFO: `/v3/projects/de474ddf801844bcb7dabe579f8d9afc/users/4cfcaf6954bc41e48af8f34d1c730fae/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:54.924685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec138d8e-8f69-4c18-93e1-df423a134a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de474ddf801844bcb7dabe579f8d9afc, user_id=4cfcaf6954bc41e48af8f34d1c730fae, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:54.928666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec138d8e-8f69-4c18-93e1-df423a134a84 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:55.017420 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1077/2143] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:54 2022] PUT /identity/v3/projects/de474ddf801844bcb7dabe579f8d9afc/users/4cfcaf6954bc41e48af8f34d1c730fae/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:55.029692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1b2f-4869-48ec-a2af-73059958dd71 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:55.033442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1b2f-4869-48ec-a2af-73059958dd71 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:55.033442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1b2f-4869-48ec-a2af-73059958dd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:55.117400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-27cf1b2f-4869-48ec-a2af-73059958dd71 None None] MFA Rules not processed for user `4cfcaf6954bc41e48af8f34d1c730fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:55.118732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-27cf1b2f-4869-48ec-a2af-73059958dd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:55.301902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1067/2144] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:55.306475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec138d8e-8f69-4c18-93e1-df423a134a84 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:55.385938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec138d8e-8f69-4c18-93e1-df423a134a84 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:55.406850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012af073-2adc-460a-a194-789fa50ba5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:55.407729 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012af073-2adc-460a-a194-789fa50ba5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:55.408023 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012af073-2adc-460a-a194-789fa50ba5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:55.408309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012af073-2adc-460a-a194-789fa50ba5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:55.409035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012af073-2adc-460a-a194-789fa50ba5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:55.411761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012af073-2adc-460a-a194-789fa50ba5c3 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:55.516592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1078/2145] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:55 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:55.516833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf1b2f-4869-48ec-a2af-73059958dd71 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:55.534629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf1b2f-4869-48ec-a2af-73059958dd71 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:55.654954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff59f8-2a44-4f46-b962-f621b5419a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:55.660228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff59f8-2a44-4f46-b962-f621b5419a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:55.660228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff59f8-2a44-4f46-b962-f621b5419a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:55.660228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff59f8-2a44-4f46-b962-f621b5419a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:55.660228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff59f8-2a44-4f46-b962-f621b5419a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:55.660228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff59f8-2a44-4f46-b962-f621b5419a0a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:55.798566 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1068/2146] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:55 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:39:55.802690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012af073-2adc-460a-a194-789fa50ba5c3 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:55.821618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012af073-2adc-460a-a194-789fa50ba5c3 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:55.830639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce75409-1309-4e8e-9980-b2618da124e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:55.831342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75409-1309-4e8e-9980-b2618da124e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:55.831633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75409-1309-4e8e-9980-b2618da124e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:55.831916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75409-1309-4e8e-9980-b2618da124e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:55.832802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce75409-1309-4e8e-9980-b2618da124e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:55.834516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce75409-1309-4e8e-9980-b2618da124e7 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:55.859403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff59f8-2a44-4f46-b962-f621b5419a0a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:55.866568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1079/2147] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:55.879281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff59f8-2a44-4f46-b962-f621b5419a0a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:55.894536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1824cd1-36c9-4cd2-857f-adb21ba17975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:55.894536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1824cd1-36c9-4cd2-857f-adb21ba17975 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:55.894536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1824cd1-36c9-4cd2-857f-adb21ba17975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:55.894536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1824cd1-36c9-4cd2-857f-adb21ba17975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:55.894905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1824cd1-36c9-4cd2-857f-adb21ba17975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:55.895683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1824cd1-36c9-4cd2-857f-adb21ba17975 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:55.915582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1069/2148] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:39:55.919210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce75409-1309-4e8e-9980-b2618da124e7 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:55.938027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce75409-1309-4e8e-9980-b2618da124e7 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:55.952916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dbbf1-12de-4f11-a649-9855e7ab812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:55.954258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dbbf1-12de-4f11-a649-9855e7ab812b admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:55.954546 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dbbf1-12de-4f11-a649-9855e7ab812b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:55.954831 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dbbf1-12de-4f11-a649-9855e7ab812b admin admin] PATH_INFO: `/v3/projects/d9724eb6dd8c42c1bda37e458af1731a/users/24fb3947cc034c4fa0fa9022d8da8b97/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:55.999771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dbbf1-12de-4f11-a649-9855e7ab812b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9724eb6dd8c42c1bda37e458af1731a, user_id=24fb3947cc034c4fa0fa9022d8da8b97, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:56.002561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dbbf1-12de-4f11-a649-9855e7ab812b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:56.127489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1080/2149] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:55 2022] PUT /identity/v3/projects/d9724eb6dd8c42c1bda37e458af1731a/users/24fb3947cc034c4fa0fa9022d8da8b97/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:56.130450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e85a49-6cb9-4991-adb8-b0e48020fd5e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:56.131288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e85a49-6cb9-4991-adb8-b0e48020fd5e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:56.131757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e85a49-6cb9-4991-adb8-b0e48020fd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:56.173582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a9e85a49-6cb9-4991-adb8-b0e48020fd5e None None] MFA Rules not processed for user `24fb3947cc034c4fa0fa9022d8da8b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:56.175468 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a9e85a49-6cb9-4991-adb8-b0e48020fd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:56.367229 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1070/2150] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:56.372392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dbbf1-12de-4f11-a649-9855e7ab812b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:56.478175 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dbbf1-12de-4f11-a649-9855e7ab812b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:56.485224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda5e60-e995-41c1-8022-4c0ffc85303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:56.486314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda5e60-e995-41c1-8022-4c0ffc85303b admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:56.486815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda5e60-e995-41c1-8022-4c0ffc85303b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:56.487322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda5e60-e995-41c1-8022-4c0ffc85303b admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:56.488242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda5e60-e995-41c1-8022-4c0ffc85303b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:56.490986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda5e60-e995-41c1-8022-4c0ffc85303b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:56.646832 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1081/2151] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:39:56 2022] POST /identity/v3/projects => generated 377 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:56.653770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e85a49-6cb9-4991-adb8-b0e48020fd5e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:56.673858 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e85a49-6cb9-4991-adb8-b0e48020fd5e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:56.817598 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1926218-dbcf-4536-b389-f4e76451ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:56.818444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1926218-dbcf-4536-b389-f4e76451ce8a admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:56.818958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1926218-dbcf-4536-b389-f4e76451ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:56.819325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1926218-dbcf-4536-b389-f4e76451ce8a admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:56.820200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1926218-dbcf-4536-b389-f4e76451ce8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:56.826217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1926218-dbcf-4536-b389-f4e76451ce8a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:56.908528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1071/2152] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:39:56 2022] POST /identity/v3/users => generated 295 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:39:56.911372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda5e60-e995-41c1-8022-4c0ffc85303b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:56.926171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda5e60-e995-41c1-8022-4c0ffc85303b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:56.946012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517eabf-ea5d-4919-b1b8-fbcbc00126d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:56.946785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517eabf-ea5d-4919-b1b8-fbcbc00126d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:56.947129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517eabf-ea5d-4919-b1b8-fbcbc00126d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:56.947601 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517eabf-ea5d-4919-b1b8-fbcbc00126d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:56.948346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517eabf-ea5d-4919-b1b8-fbcbc00126d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:56.950060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517eabf-ea5d-4919-b1b8-fbcbc00126d6 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:56.974360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1082/2153] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:39:56.979313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1926218-dbcf-4536-b389-f4e76451ce8a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:56.994124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1926218-dbcf-4536-b389-f4e76451ce8a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:57.010060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6b054-68c2-428c-b785-ad344ba8f24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:57.011119 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b054-68c2-428c-b785-ad344ba8f24b admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:57.011544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b054-68c2-428c-b785-ad344ba8f24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:57.012082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b054-68c2-428c-b785-ad344ba8f24b admin admin] PATH_INFO: `/v3/projects/0658db07ac134f75bef09eb2cc834c84/users/c9cfdde0310b4b489642a8e3a9150a3a/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:57.074445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6b054-68c2-428c-b785-ad344ba8f24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0658db07ac134f75bef09eb2cc834c84, user_id=c9cfdde0310b4b489642a8e3a9150a3a, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:57.080836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6b054-68c2-428c-b785-ad344ba8f24b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:57.165400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1072/2154] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:56 2022] PUT /identity/v3/projects/0658db07ac134f75bef09eb2cc834c84/users/c9cfdde0310b4b489642a8e3a9150a3a/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:57.169260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517eabf-ea5d-4919-b1b8-fbcbc00126d6 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:57.194056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517eabf-ea5d-4919-b1b8-fbcbc00126d6 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:57.292285 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839b2b9-d99b-4c05-a662-a512f4a5eaff None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:57.292950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839b2b9-d99b-4c05-a662-a512f4a5eaff None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:57.293451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839b2b9-d99b-4c05-a662-a512f4a5eaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:57.317458 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ec352-6c38-4ea8-9f7c-eb4528fa988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:57.318532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ec352-6c38-4ea8-9f7c-eb4528fa988d admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:57.319068 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ec352-6c38-4ea8-9f7c-eb4528fa988d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:57.319436 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ec352-6c38-4ea8-9f7c-eb4528fa988d admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:57.320383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ec352-6c38-4ea8-9f7c-eb4528fa988d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:57.322293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ec352-6c38-4ea8-9f7c-eb4528fa988d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:57.357547 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0839b2b9-d99b-4c05-a662-a512f4a5eaff None None] MFA Rules not processed for user `2a2b95ccb7804311a011f37ccb371771`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:57.357547 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0839b2b9-d99b-4c05-a662-a512f4a5eaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:57.359152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1083/2155] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:39:57.370901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ec352-6c38-4ea8-9f7c-eb4528fa988d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:57.399081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ec352-6c38-4ea8-9f7c-eb4528fa988d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:57.431761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331f6ba-177c-4665-9a60-83171a163a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:57.432938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331f6ba-177c-4665-9a60-83171a163a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:57.433934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331f6ba-177c-4665-9a60-83171a163a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:57.434742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331f6ba-177c-4665-9a60-83171a163a1a admin admin] PATH_INFO: `/v3/projects/0658db07ac134f75bef09eb2cc834c84/users/c9cfdde0310b4b489642a8e3a9150a3a/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:57.448595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331f6ba-177c-4665-9a60-83171a163a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0658db07ac134f75bef09eb2cc834c84, user_id=c9cfdde0310b4b489642a8e3a9150a3a, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:57.448595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331f6ba-177c-4665-9a60-83171a163a1a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:57.521866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1084/2156] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:39:57 2022] PUT /identity/v3/projects/0658db07ac134f75bef09eb2cc834c84/users/c9cfdde0310b4b489642a8e3a9150a3a/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:39:57.569188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b0e4-08cb-4153-b571-29c5ccb38742 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:57.571177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b0e4-08cb-4153-b571-29c5ccb38742 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:57.571465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b0e4-08cb-4153-b571-29c5ccb38742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:57.604284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1073/2157] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:57.661503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-6677b0e4-08cb-4153-b571-29c5ccb38742 None None] MFA Rules not processed for user `c9cfdde0310b4b489642a8e3a9150a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:39:57.664114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6677b0e4-08cb-4153-b571-29c5ccb38742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:57.808343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1085/2158] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:39:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:39:57.821147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839b2b9-d99b-4c05-a662-a512f4a5eaff None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:39:57.822668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0839b2b9-d99b-4c05-a662-a512f4a5eaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:39:57.913326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839b2b9-d99b-4c05-a662-a512f4a5eaff None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:39:57.979162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08964b97-70f1-4888-a7dc-37f19b777f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:39:57.979831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08964b97-70f1-4888-a7dc-37f19b777f6c service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:39:57.980115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08964b97-70f1-4888-a7dc-37f19b777f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:39:57.980395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08964b97-70f1-4888-a7dc-37f19b777f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:39:58.051570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08964b97-70f1-4888-a7dc-37f19b777f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:39:58.053062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08964b97-70f1-4888-a7dc-37f19b777f6c service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:39:58.062259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1074/2159] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:39:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:40:00.530648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677b0e4-08cb-4153-b571-29c5ccb38742 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:00.543266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677b0e4-08cb-4153-b571-29c5ccb38742 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:00.549961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9da787-3f9b-428d-a19e-b01a6582abdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:00.550893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da787-3f9b-428d-a19e-b01a6582abdf service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:00.551948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da787-3f9b-428d-a19e-b01a6582abdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:00.552407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da787-3f9b-428d-a19e-b01a6582abdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:00.646446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9da787-3f9b-428d-a19e-b01a6582abdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:00.650643 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9da787-3f9b-428d-a19e-b01a6582abdf service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:00.660594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1086/2160] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:40:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:40:03.121805 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08964b97-70f1-4888-a7dc-37f19b777f6c service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:03.134407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08964b97-70f1-4888-a7dc-37f19b777f6c service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:03.139474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e663e8c-6671-433c-b488-0934934564dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:03.141110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e663e8c-6671-433c-b488-0934934564dc service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:03.142001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e663e8c-6671-433c-b488-0934934564dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:03.142437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e663e8c-6671-433c-b488-0934934564dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:03.157576 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e663e8c-6671-433c-b488-0934934564dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:03.159545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e663e8c-6671-433c-b488-0934934564dc service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:03.188587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1075/2161] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:40:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:40:03.212706 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ecad-093d-420a-865b-3eb991f4b82f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:03.213302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ecad-093d-420a-865b-3eb991f4b82f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:03.213302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5ecad-093d-420a-865b-3eb991f4b82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:03.253753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-48f5ecad-093d-420a-865b-3eb991f4b82f None None] MFA Rules not processed for user `606b53c6f60d45cf9e2c3e5c6c9cde2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:03.254996 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-48f5ecad-093d-420a-865b-3eb991f4b82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:03.332570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1087/2162] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:40:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:40:03.389541 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8701d0-9729-497d-a18a-c46863ff1ac5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:03.390102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8701d0-9729-497d-a18a-c46863ff1ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:03.390391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8701d0-9729-497d-a18a-c46863ff1ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:03.410377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4e8701d0-9729-497d-a18a-c46863ff1ac5 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:03.411942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4e8701d0-9729-497d-a18a-c46863ff1ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:03.512284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1076/2163] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:40:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:40:03.530484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ecad-093d-420a-865b-3eb991f4b82f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:03.532128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-48f5ecad-093d-420a-865b-3eb991f4b82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:03.647699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5ecad-093d-420a-865b-3eb991f4b82f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:03.654571 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ee2e1-340d-4465-9fe2-131b2dfc75e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:03.656226 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ee2e1-340d-4465-9fe2-131b2dfc75e2 service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:03.656679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ee2e1-340d-4465-9fe2-131b2dfc75e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:03.657120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ee2e1-340d-4465-9fe2-131b2dfc75e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:03.666536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ee2e1-340d-4465-9fe2-131b2dfc75e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:03.668152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ee2e1-340d-4465-9fe2-131b2dfc75e2 service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:03.678829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1088/2164] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:40:09.399241 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50768af6-c88e-4963-ba11-88a86a460110 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:09.399772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50768af6-c88e-4963-ba11-88a86a460110 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:09.400029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50768af6-c88e-4963-ba11-88a86a460110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:09.442865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-50768af6-c88e-4963-ba11-88a86a460110 None None] MFA Rules not processed for user `d6afc66e1d4b473e9a8e6abf1737b64d`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:09.446444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-50768af6-c88e-4963-ba11-88a86a460110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:09.574316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1077/2165] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:40:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:40:10.073582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ee2e1-340d-4465-9fe2-131b2dfc75e2 service swift] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:10.182606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ee2e1-340d-4465-9fe2-131b2dfc75e2 service swift] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:10.192827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:10.194435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:10.194987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:10.196955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] PATH_INFO: `/v3/users/4cfcaf6954bc41e48af8f34d1c730fae` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:10.200082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cfcaf6954bc41e48af8f34d1c730fae)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:10.203737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:10.488437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cfcaf6954bc41e48af8f34d1c730fae'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:10.489790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cfcaf6954bc41e48af8f34d1c730fae'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:10.492096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cfcaf6954bc41e48af8f34d1c730fae'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:10.539631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cfcaf6954bc41e48af8f34d1c730fae'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:10.558892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cfcaf6954bc41e48af8f34d1c730fae'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:10.671290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1089/2166] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:40:10 2022] DELETE /identity/v3/users/4cfcaf6954bc41e48af8f34d1c730fae => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:40:10.676260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a3a9-fcc5-4961-b1ac-c02ed7d11f29 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:10.676746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a3a9-fcc5-4961-b1ac-c02ed7d11f29 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:10.676928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a3a9-fcc5-4961-b1ac-c02ed7d11f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:10.726775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-eeb0a3a9-fcc5-4961-b1ac-c02ed7d11f29 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:10.726775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-eeb0a3a9-fcc5-4961-b1ac-c02ed7d11f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:10.821728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1078/2167] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:40:10.828733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:10.830337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:10.944461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6b9a9-8c26-4697-bed5-c2a7bb80fb67 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:10.961063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6761a1d-0081-4dad-9206-28977084e0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:10.961063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6761a1d-0081-4dad-9206-28977084e0ea service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:10.961063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6761a1d-0081-4dad-9206-28977084e0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:10.961063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6761a1d-0081-4dad-9206-28977084e0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:10.982732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6761a1d-0081-4dad-9206-28977084e0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:10.984737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6761a1d-0081-4dad-9206-28977084e0ea service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:11.014670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1090/2168] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:40:11.665643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a3a9-fcc5-4961-b1ac-c02ed7d11f29 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:11.665643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-eeb0a3a9-fcc5-4961-b1ac-c02ed7d11f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:11.691544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a3a9-fcc5-4961-b1ac-c02ed7d11f29 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:11.707358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:11.713500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:11.713887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:11.714255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] PATH_INFO: `/v3/projects/de474ddf801844bcb7dabe579f8d9afc` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:11.715609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de474ddf801844bcb7dabe579f8d9afc)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:11.721859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:11.901687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de474ddf801844bcb7dabe579f8d9afc', 'request_id': 'req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:11.922248 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de474ddf801844bcb7dabe579f8d9afc', 'request_id': 'req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:11.996287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de474ddf801844bcb7dabe579f8d9afc', 'request_id': 'req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:12.018771 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] The token cache is being invalidate because project de474ddf801844bcb7dabe579f8d9afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:40:12.019331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:12.020446 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:12.026059 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1079/2169] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:40:11 2022] DELETE /identity/v3/projects/de474ddf801844bcb7dabe579f8d9afc => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:40:12.027579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6761a1d-0081-4dad-9206-28977084e0ea service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:12.038479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6761a1d-0081-4dad-9206-28977084e0ea service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:12.131691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:12.132570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:12.132852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:12.133135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] PATH_INFO: `/v3/users/24fb3947cc034c4fa0fa9022d8da8b97` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:12.134358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24fb3947cc034c4fa0fa9022d8da8b97)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:12.137747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:12.329679 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24fb3947cc034c4fa0fa9022d8da8b97'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:12.330310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24fb3947cc034c4fa0fa9022d8da8b97'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:12.330914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24fb3947cc034c4fa0fa9022d8da8b97'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:12.344631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24fb3947cc034c4fa0fa9022d8da8b97'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:12.351713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24fb3947cc034c4fa0fa9022d8da8b97'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:12.438963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1091/2170] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:40:12 2022] DELETE /identity/v3/users/24fb3947cc034c4fa0fa9022d8da8b97 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:40:13.426109 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:13.427839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:13.442114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37cfa7-292e-43f4-bbcf-8d9c89d60c54 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:13.587051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:13.588211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:13.588573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:13.589054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] PATH_INFO: `/v3/projects/d9724eb6dd8c42c1bda37e458af1731a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:13.590510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9724eb6dd8c42c1bda37e458af1731a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:13.593170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:13.785477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9724eb6dd8c42c1bda37e458af1731a', 'request_id': 'req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:13.793026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9724eb6dd8c42c1bda37e458af1731a', 'request_id': 'req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:13.915656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9724eb6dd8c42c1bda37e458af1731a', 'request_id': 'req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:13.941384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] The token cache is being invalidate because project d9724eb6dd8c42c1bda37e458af1731a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:40:13.942474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:13.944287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:13.949321 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1080/2171] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:40:13 2022] DELETE /identity/v3/projects/d9724eb6dd8c42c1bda37e458af1731a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:40:13.950724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:13.953496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:13.974290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e1566-75c7-407d-b615-d7d61d4a6ef4 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:14.053426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:14.054497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:14.054795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:14.055077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] PATH_INFO: `/v3/users/c9cfdde0310b4b489642a8e3a9150a3a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:14.065375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9cfdde0310b4b489642a8e3a9150a3a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:14.065375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:14.302630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9cfdde0310b4b489642a8e3a9150a3a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:14.305217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9cfdde0310b4b489642a8e3a9150a3a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:14.306134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9cfdde0310b4b489642a8e3a9150a3a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:14.336214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9cfdde0310b4b489642a8e3a9150a3a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:14.356906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4d3fee04-43ea-4368-9ff7-d6ae03310276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9cfdde0310b4b489642a8e3a9150a3a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:14.499468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1092/2172] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:40:13 2022] DELETE /identity/v3/users/c9cfdde0310b4b489642a8e3a9150a3a => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:40:15.239791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:15.242265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:15.266732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcd1c8-fca3-4730-872e-cc837dcf4cf6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:15.450124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:15.451487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:15.452444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:15.452811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] PATH_INFO: `/v3/projects/0658db07ac134f75bef09eb2cc834c84` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:15.455097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0658db07ac134f75bef09eb2cc834c84)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:15.457133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:15.671606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0658db07ac134f75bef09eb2cc834c84', 'request_id': 'req-3dade3b9-1d45-4c43-bf77-26e6001b4656'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:15.686340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0658db07ac134f75bef09eb2cc834c84', 'request_id': 'req-3dade3b9-1d45-4c43-bf77-26e6001b4656'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:15.790047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0658db07ac134f75bef09eb2cc834c84', 'request_id': 'req-3dade3b9-1d45-4c43-bf77-26e6001b4656'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:15.813060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] The token cache is being invalidate because project 0658db07ac134f75bef09eb2cc834c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:40:15.813320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:15.814064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:40:15.825663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1081/2173] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:40:15 2022] DELETE /identity/v3/projects/0658db07ac134f75bef09eb2cc834c84 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:40:16.830464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d965778-c76d-4ddb-8933-beda20df2f04 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:16.831431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d965778-c76d-4ddb-8933-beda20df2f04 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:16.831974 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d965778-c76d-4ddb-8933-beda20df2f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:16.890683 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-6d965778-c76d-4ddb-8933-beda20df2f04 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:16.891913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6d965778-c76d-4ddb-8933-beda20df2f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:17.069207 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1093/2174] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:40:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:40:17.091627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:17.093263 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:17.246796 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade3b9-1d45-4c43-bf77-26e6001b4656 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:17.259062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753bcb4-7aef-425a-90e2-d9be4be683c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:17.259791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753bcb4-7aef-425a-90e2-d9be4be683c1 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:17.262697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753bcb4-7aef-425a-90e2-d9be4be683c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:17.263058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753bcb4-7aef-425a-90e2-d9be4be683c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:17.290679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753bcb4-7aef-425a-90e2-d9be4be683c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:17.307142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753bcb4-7aef-425a-90e2-d9be4be683c1 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:17.313594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1082/2175] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:40:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:40:38.938328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54325b85-cef5-4ad2-9e0e-6c731cebfc01 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:38.938908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54325b85-cef5-4ad2-9e0e-6c731cebfc01 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:38.938908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54325b85-cef5-4ad2-9e0e-6c731cebfc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:38.957961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-54325b85-cef5-4ad2-9e0e-6c731cebfc01 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:38.959143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-54325b85-cef5-4ad2-9e0e-6c731cebfc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:38.966243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1094/2176] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:40:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:40:38.979550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753bcb4-7aef-425a-90e2-d9be4be683c1 service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:38.990579 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753bcb4-7aef-425a-90e2-d9be4be683c1 service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:38.995484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e40380-bcc4-4948-a0a0-f5f812c7a58a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:38.996114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40380-bcc4-4948-a0a0-f5f812c7a58a service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:38.996398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40380-bcc4-4948-a0a0-f5f812c7a58a service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:38.996671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40380-bcc4-4948-a0a0-f5f812c7a58a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:39.006004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40380-bcc4-4948-a0a0-f5f812c7a58a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:39.007575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40380-bcc4-4948-a0a0-f5f812c7a58a service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:39.015539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1083/2177] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:40:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 20:40:42.082062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58f2e8-3be0-4a5a-a870-cbcc93ccb51a None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:42.082695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58f2e8-3be0-4a5a-a870-cbcc93ccb51a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:42.082695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58f2e8-3be0-4a5a-a870-cbcc93ccb51a None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:42.084450 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1095/2178] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 12 20:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:40:42.091693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c1862-ec12-46f2-82a6-da801409cfda None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:42.093553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c1862-ec12-46f2-82a6-da801409cfda None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:42.094071 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c1862-ec12-46f2-82a6-da801409cfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:42.182285 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-314c1862-ec12-46f2-82a6-da801409cfda None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:42.183549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-314c1862-ec12-46f2-82a6-da801409cfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:42.300637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1084/2179] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 12 20:40:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:40:42.314380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58f2e8-3be0-4a5a-a870-cbcc93ccb51a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:42.316054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-cc58f2e8-3be0-4a5a-a870-cbcc93ccb51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:42.396499 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58f2e8-3be0-4a5a-a870-cbcc93ccb51a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:42.400132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef710236-8f0a-453f-a8fa-6a29283788e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f8ec4765e05461a98b3c9eb1d3ced5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:42.404984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710236-8f0a-453f-a8fa-6a29283788e3 service glance] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:42.404984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710236-8f0a-453f-a8fa-6a29283788e3 service glance] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:42.404984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710236-8f0a-453f-a8fa-6a29283788e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:42.412044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef710236-8f0a-453f-a8fa-6a29283788e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:42.413555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef710236-8f0a-453f-a8fa-6a29283788e3 service glance] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:42.424445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1096/2180] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:40:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:40:42.664606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1731f1e-8ee1-4e9b-aa8b-973a6f92376a None None] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:42.664809 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1731f1e-8ee1-4e9b-aa8b-973a6f92376a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:42.665102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1731f1e-8ee1-4e9b-aa8b-973a6f92376a None None] PATH_INFO: `/` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:42.667582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1085/2181] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 12 20:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:40:42.673375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d2a6-ab6b-47fd-aaa0-2a9ccf588dbb None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:42.674204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d2a6-ab6b-47fd-aaa0-2a9ccf588dbb None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:42.674784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32d2a6-ab6b-47fd-aaa0-2a9ccf588dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:42.713215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-0d32d2a6-ab6b-47fd-aaa0-2a9ccf588dbb None None] MFA Rules not processed for user `4379d3e8b38645978efb08ea6f560fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:42.715446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0d32d2a6-ab6b-47fd-aaa0-2a9ccf588dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:42.784852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1097/2182] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 12 20:40:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:40:42.791520 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1731f1e-8ee1-4e9b-aa8b-973a6f92376a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:42.793210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d1731f1e-8ee1-4e9b-aa8b-973a6f92376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:42.810084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1731f1e-8ee1-4e9b-aa8b-973a6f92376a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:42.814615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463c365-5861-4fe3-b7f4-e6f6ac32cd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:42.815252 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463c365-5861-4fe3-b7f4-e6f6ac32cd65 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:42.815576 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463c365-5861-4fe3-b7f4-e6f6ac32cd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:42.815936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463c365-5861-4fe3-b7f4-e6f6ac32cd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:42.823693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463c365-5861-4fe3-b7f4-e6f6ac32cd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:42.825364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463c365-5861-4fe3-b7f4-e6f6ac32cd65 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:42.834699 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1086/2183] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:40:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:40:42.926981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d67e-6df9-4cf5-bfe9-e1b73df9e190 None None] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:42.927653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d67e-6df9-4cf5-bfe9-e1b73df9e190 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:42.927964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d67e-6df9-4cf5-bfe9-e1b73df9e190 None None] PATH_INFO: `/` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:42.929365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1098/2184] 10.222.0.59 () {54 vars in 921 bytes} [Thu May 12 20:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 20:40:42.935259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403f9f8-857a-4544-ab46-1ae6f983445c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:42.935706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403f9f8-857a-4544-ab46-1ae6f983445c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:42.936062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403f9f8-857a-4544-ab46-1ae6f983445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:42.958650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3403f9f8-857a-4544-ab46-1ae6f983445c None None] MFA Rules not processed for user `156646eda779439784ddbc7d1fbd5b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:42.960168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3403f9f8-857a-4544-ab46-1ae6f983445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:42.971554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1087/2185] 10.222.0.59 () {58 vars in 1018 bytes} [Thu May 12 20:40:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:40:42.983051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95d67e-6df9-4cf5-bfe9-e1b73df9e190 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:42.996327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95d67e-6df9-4cf5-bfe9-e1b73df9e190 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:43.001345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d1b1c-70e2-4326-bc6e-f2c4cfa7d57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:43.002022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1b1c-70e2-4326-bc6e-f2c4cfa7d57b service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:43.002324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1b1c-70e2-4326-bc6e-f2c4cfa7d57b service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:43.002594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1b1c-70e2-4326-bc6e-f2c4cfa7d57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:43.014921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d1b1c-70e2-4326-bc6e-f2c4cfa7d57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:43.016243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d1b1c-70e2-4326-bc6e-f2c4cfa7d57b service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:43.028662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1099/2186] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:40:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:40:53.027280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04335ad-20b4-4b48-8b82-ae5d9a057f44 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:53.028439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04335ad-20b4-4b48-8b82-ae5d9a057f44 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:53.029374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04335ad-20b4-4b48-8b82-ae5d9a057f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:53.083848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d04335ad-20b4-4b48-8b82-ae5d9a057f44 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:53.085226 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d04335ad-20b4-4b48-8b82-ae5d9a057f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:53.105673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1088/2187] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:40:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:40:53.123345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d1b1c-70e2-4326-bc6e-f2c4cfa7d57b service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:53.154715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d1b1c-70e2-4326-bc6e-f2c4cfa7d57b service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:53.160978 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717da6-6bd6-42fd-86ee-9e28181553a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:53.161734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717da6-6bd6-42fd-86ee-9e28181553a4 service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:53.161951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717da6-6bd6-42fd-86ee-9e28181553a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:53.162510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717da6-6bd6-42fd-86ee-9e28181553a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:53.174158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717da6-6bd6-42fd-86ee-9e28181553a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:53.176352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717da6-6bd6-42fd-86ee-9e28181553a4 service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:53.187155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1100/2188] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:40:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:40:57.800714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1ef9-ded1-406f-a9d4-4c287aeff508 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:57.801241 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1ef9-ded1-406f-a9d4-4c287aeff508 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:57.801368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1ef9-ded1-406f-a9d4-4c287aeff508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:57.819795 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-851e1ef9-ded1-406f-a9d4-4c287aeff508 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:40:57.821019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-851e1ef9-ded1-406f-a9d4-4c287aeff508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:40:57.836866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1089/2189] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 12 20:40:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:40:57.847202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717da6-6bd6-42fd-86ee-9e28181553a4 service swift] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:40:57.865236 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717da6-6bd6-42fd-86ee-9e28181553a4 service swift] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:40:57.877178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e4ec5-3da7-4246-aba6-6975cdf412d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:40:57.878033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e4ec5-3da7-4246-aba6-6975cdf412d8 service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:40:57.878419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e4ec5-3da7-4246-aba6-6975cdf412d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:40:57.878795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e4ec5-3da7-4246-aba6-6975cdf412d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:40:57.891660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e4ec5-3da7-4246-aba6-6975cdf412d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:40:57.893712 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e4ec5-3da7-4246-aba6-6975cdf412d8 service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:40:57.907432 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1101/2190] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:40:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:41:02.094745 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e1ef9-ded1-406f-a9d4-4c287aeff508 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:02.096820 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-851e1ef9-ded1-406f-a9d4-4c287aeff508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:02.237354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e1ef9-ded1-406f-a9d4-4c287aeff508 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:02.242164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:02.243024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:02.243312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:02.243613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] PATH_INFO: `/v3/users/eb3a1cc28fbe48b18d0fd19415cd7a53` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:02.244861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3a1cc28fbe48b18d0fd19415cd7a53)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:02.246969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:02.458509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3a1cc28fbe48b18d0fd19415cd7a53'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:02.470582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3a1cc28fbe48b18d0fd19415cd7a53'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:02.471288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3a1cc28fbe48b18d0fd19415cd7a53'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:02.593708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3a1cc28fbe48b18d0fd19415cd7a53'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:02.601096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4548a192-39f7-498b-9379-9fc7023c59f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3a1cc28fbe48b18d0fd19415cd7a53'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:02.607681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1090/2191] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:41:02 2022] DELETE /identity/v3/users/eb3a1cc28fbe48b18d0fd19415cd7a53 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:02.852034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e4ec5-3da7-4246-aba6-6975cdf412d8 service swift] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:02.866767 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e4ec5-3da7-4246-aba6-6975cdf412d8 service swift] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:02.924009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:02.924880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:02.925162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:02.925471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] PATH_INFO: `/v3/projects/43069e4b5d394dc4a733cf11628eac72` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:02.926658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43069e4b5d394dc4a733cf11628eac72)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:02.928558 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:03.028056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43069e4b5d394dc4a733cf11628eac72', 'request_id': 'req-41f71d9f-778f-4d96-99a6-754753cf43e5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:03.033301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43069e4b5d394dc4a733cf11628eac72', 'request_id': 'req-41f71d9f-778f-4d96-99a6-754753cf43e5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:03.086516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43069e4b5d394dc4a733cf11628eac72', 'request_id': 'req-41f71d9f-778f-4d96-99a6-754753cf43e5'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:03.098296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] The token cache is being invalidate because project 43069e4b5d394dc4a733cf11628eac72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:41:03.098589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:03.104488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-41f71d9f-778f-4d96-99a6-754753cf43e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:03.104488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1102/2192] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:41:02 2022] DELETE /identity/v3/projects/43069e4b5d394dc4a733cf11628eac72 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:03.105822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95760-8c05-4fa4-a898-c0f8433bf6d7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:03.106317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95760-8c05-4fa4-a898-c0f8433bf6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:03.106408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95760-8c05-4fa4-a898-c0f8433bf6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:03.127816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c2c95760-8c05-4fa4-a898-c0f8433bf6d7 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:03.127816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c2c95760-8c05-4fa4-a898-c0f8433bf6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:03.186590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1091/2193] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:03.194589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169b6e4-3e53-4775-ae92-103f457387bc None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:03.194908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169b6e4-3e53-4775-ae92-103f457387bc None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:03.195192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169b6e4-3e53-4775-ae92-103f457387bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:03.214474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-4169b6e4-3e53-4775-ae92-103f457387bc None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:03.215681 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4169b6e4-3e53-4775-ae92-103f457387bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:03.245107 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1103/2194] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:03.249949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95760-8c05-4fa4-a898-c0f8433bf6d7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:03.261319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95760-8c05-4fa4-a898-c0f8433bf6d7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:03.266522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf95213-1366-4a30-806f-5f26f30e8ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:03.267369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95213-1366-4a30-806f-5f26f30e8ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:03.267669 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95213-1366-4a30-806f-5f26f30e8ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:03.268094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95213-1366-4a30-806f-5f26f30e8ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:03.268896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf95213-1366-4a30-806f-5f26f30e8ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:41:03.269207 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf95213-1366-4a30-806f-5f26f30e8ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:03.271308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf95213-1366-4a30-806f-5f26f30e8ed0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:03.285536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1092/2195] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:41:03.290311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169b6e4-3e53-4775-ae92-103f457387bc None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:03.300793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169b6e4-3e53-4775-ae92-103f457387bc None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:03.305702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199b7a5-04ce-4e4a-aab1-2520703b986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:03.306379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b7a5-04ce-4e4a-aab1-2520703b986c admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:03.306668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b7a5-04ce-4e4a-aab1-2520703b986c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:03.306950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199b7a5-04ce-4e4a-aab1-2520703b986c admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:03.310298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199b7a5-04ce-4e4a-aab1-2520703b986c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:03.310298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199b7a5-04ce-4e4a-aab1-2520703b986c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:03.412273 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1104/2196] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:41:03 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:41:03.413555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf95213-1366-4a30-806f-5f26f30e8ed0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:03.424346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf95213-1366-4a30-806f-5f26f30e8ed0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:03.478726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593886c2-5dfc-4c17-b1e8-c8f9c8d9fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:03.479397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593886c2-5dfc-4c17-b1e8-c8f9c8d9fd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:03.479687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593886c2-5dfc-4c17-b1e8-c8f9c8d9fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:03.479974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593886c2-5dfc-4c17-b1e8-c8f9c8d9fd39 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:03.480664 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593886c2-5dfc-4c17-b1e8-c8f9c8d9fd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:03.483365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593886c2-5dfc-4c17-b1e8-c8f9c8d9fd39 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:03.599412 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1093/2197] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:41:03 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:41:03.603484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199b7a5-04ce-4e4a-aab1-2520703b986c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:03.613725 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199b7a5-04ce-4e4a-aab1-2520703b986c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:03.618536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da05d9d-bf1d-4a8f-9e8d-188d858d7417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:03.619200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da05d9d-bf1d-4a8f-9e8d-188d858d7417 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:03.619487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da05d9d-bf1d-4a8f-9e8d-188d858d7417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:03.619766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da05d9d-bf1d-4a8f-9e8d-188d858d7417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:03.620544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da05d9d-bf1d-4a8f-9e8d-188d858d7417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:03.622175 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da05d9d-bf1d-4a8f-9e8d-188d858d7417 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:03.632949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1105/2198] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:41:03.636754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593886c2-5dfc-4c17-b1e8-c8f9c8d9fd39 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:03.647199 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593886c2-5dfc-4c17-b1e8-c8f9c8d9fd39 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:03.652799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee1e51-cbc3-4e06-8b15-4e132f1a7381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:03.654098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee1e51-cbc3-4e06-8b15-4e132f1a7381 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:03.654390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee1e51-cbc3-4e06-8b15-4e132f1a7381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:03.654676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee1e51-cbc3-4e06-8b15-4e132f1a7381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:03.655403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee1e51-cbc3-4e06-8b15-4e132f1a7381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:03.656984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee1e51-cbc3-4e06-8b15-4e132f1a7381 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:03.666891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1094/2199] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:41:03.671588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da05d9d-bf1d-4a8f-9e8d-188d858d7417 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:03.681578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da05d9d-bf1d-4a8f-9e8d-188d858d7417 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:03.686846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa33dd7-f5f3-4eb2-87f2-0ac45e571f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:03.687739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33dd7-f5f3-4eb2-87f2-0ac45e571f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:03.688025 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33dd7-f5f3-4eb2-87f2-0ac45e571f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:03.688433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33dd7-f5f3-4eb2-87f2-0ac45e571f09 admin admin] PATH_INFO: `/v3/projects/f52c9bcd48384b258a4b8b5583d6fd64/users/917fa3be426a4b9994b82ab889e86e9d/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:03.704217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa33dd7-f5f3-4eb2-87f2-0ac45e571f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52c9bcd48384b258a4b8b5583d6fd64, user_id=917fa3be426a4b9994b82ab889e86e9d, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:03.707060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa33dd7-f5f3-4eb2-87f2-0ac45e571f09 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:03.834347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1106/2200] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:41:03 2022] PUT /identity/v3/projects/f52c9bcd48384b258a4b8b5583d6fd64/users/917fa3be426a4b9994b82ab889e86e9d/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:03.845568 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4c117-9a77-4182-baea-1a87043d481a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:03.845861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4c117-9a77-4182-baea-1a87043d481a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:03.846153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4c117-9a77-4182-baea-1a87043d481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:03.873518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e5f4c117-9a77-4182-baea-1a87043d481a None None] MFA Rules not processed for user `917fa3be426a4b9994b82ab889e86e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:03.878519 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e5f4c117-9a77-4182-baea-1a87043d481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:03.939563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1095/2201] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:03.951482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa33dd7-f5f3-4eb2-87f2-0ac45e571f09 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:03.953341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4aa33dd7-f5f3-4eb2-87f2-0ac45e571f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:04.030040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa33dd7-f5f3-4eb2-87f2-0ac45e571f09 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:04.033820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ff7f-a1f7-4b1c-8128-4a840713c413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:04.034469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ff7f-a1f7-4b1c-8128-4a840713c413 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:04.034758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ff7f-a1f7-4b1c-8128-4a840713c413 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:04.035038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ff7f-a1f7-4b1c-8128-4a840713c413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:04.043389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ff7f-a1f7-4b1c-8128-4a840713c413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:04.044848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ff7f-a1f7-4b1c-8128-4a840713c413 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:04.053405 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1107/2202] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:41:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:41:06.726194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4c117-9a77-4182-baea-1a87043d481a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:06.727604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e5f4c117-9a77-4182-baea-1a87043d481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:06.788718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4c117-9a77-4182-baea-1a87043d481a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:06.792838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3cca2-72ab-4948-8dcc-db9b7a42980b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:06.794153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3cca2-72ab-4948-8dcc-db9b7a42980b service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:06.794307 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3cca2-72ab-4948-8dcc-db9b7a42980b service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:06.794913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3cca2-72ab-4948-8dcc-db9b7a42980b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:06.797695 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bac3cca2-72ab-4948-8dcc-db9b7a42980b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:06.872024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3cca2-72ab-4948-8dcc-db9b7a42980b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:06.875270 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3cca2-72ab-4948-8dcc-db9b7a42980b service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:06.891038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1096/2203] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:41:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:41:08.198731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ff7f-a1f7-4b1c-8128-4a840713c413 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:08.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ff7f-a1f7-4b1c-8128-4a840713c413 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:08.279075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:08.279862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:08.280173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:08.280507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] PATH_INFO: `/v3/users/917fa3be426a4b9994b82ab889e86e9d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:08.281765 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917fa3be426a4b9994b82ab889e86e9d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:08.283688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:08.494818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917fa3be426a4b9994b82ab889e86e9d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:08.495499 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917fa3be426a4b9994b82ab889e86e9d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:08.496105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917fa3be426a4b9994b82ab889e86e9d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:08.509187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917fa3be426a4b9994b82ab889e86e9d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:08.516579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917fa3be426a4b9994b82ab889e86e9d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:08.579636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1108/2204] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:41:08 2022] DELETE /identity/v3/users/917fa3be426a4b9994b82ab889e86e9d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:08.584050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55fba-1a3f-4c5f-a17c-96a505550bcf None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:08.584652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55fba-1a3f-4c5f-a17c-96a505550bcf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:08.584652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55fba-1a3f-4c5f-a17c-96a505550bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:08.602453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e6d55fba-1a3f-4c5f-a17c-96a505550bcf None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:08.603778 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e6d55fba-1a3f-4c5f-a17c-96a505550bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:08.606723 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:08.608276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:08.672593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1097/2205] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:08.682573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55fba-1a3f-4c5f-a17c-96a505550bcf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:08.684073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e6d55fba-1a3f-4c5f-a17c-96a505550bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:08.719342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e5775-aa90-413d-98c8-eeafe7b00926 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:08.726581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e15a4-f3e0-4faf-8a3e-35273cc1caea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:08.728686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e15a4-f3e0-4faf-8a3e-35273cc1caea service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:08.729090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e15a4-f3e0-4faf-8a3e-35273cc1caea service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:08.729385 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e15a4-f3e0-4faf-8a3e-35273cc1caea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:08.733136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4a9e15a4-f3e0-4faf-8a3e-35273cc1caea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:08.750583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e15a4-f3e0-4faf-8a3e-35273cc1caea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:08.752347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e15a4-f3e0-4faf-8a3e-35273cc1caea service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:08.754416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55fba-1a3f-4c5f-a17c-96a505550bcf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:08.759177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df2106-64bd-43a8-9eef-a73a28564b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:08.760072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df2106-64bd-43a8-9eef-a73a28564b85 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:08.760524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df2106-64bd-43a8-9eef-a73a28564b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:08.760969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df2106-64bd-43a8-9eef-a73a28564b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:08.763529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1109/2206] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:41:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:41:08.773883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df2106-64bd-43a8-9eef-a73a28564b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:08.775318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df2106-64bd-43a8-9eef-a73a28564b85 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:08.787419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1098/2207] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:41:09.366560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e15a4-f3e0-4faf-8a3e-35273cc1caea service placement] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:09.368546 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4a9e15a4-f3e0-4faf-8a3e-35273cc1caea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:09.384947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e15a4-f3e0-4faf-8a3e-35273cc1caea service placement] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:09.390817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:09.391750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:09.392039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:09.392501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] PATH_INFO: `/v3/projects/f52c9bcd48384b258a4b8b5583d6fd64` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:09.393803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52c9bcd48384b258a4b8b5583d6fd64)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:09.395917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:09.533143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52c9bcd48384b258a4b8b5583d6fd64', 'request_id': 'req-d4b99f89-a4b7-43cc-8b27-28aefe951470'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:09.540503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52c9bcd48384b258a4b8b5583d6fd64', 'request_id': 'req-d4b99f89-a4b7-43cc-8b27-28aefe951470'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:09.616474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52c9bcd48384b258a4b8b5583d6fd64', 'request_id': 'req-d4b99f89-a4b7-43cc-8b27-28aefe951470'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:09.632945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] The token cache is being invalidate because project f52c9bcd48384b258a4b8b5583d6fd64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:41:09.633261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:09.633938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d4b99f89-a4b7-43cc-8b27-28aefe951470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:09.636005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1110/2208] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:41:09 2022] DELETE /identity/v3/projects/f52c9bcd48384b258a4b8b5583d6fd64 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:09.640936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4eac0-527c-4a54-8b4c-79e217235c20 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:09.642878 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4eac0-527c-4a54-8b4c-79e217235c20 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:09.642878 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4eac0-527c-4a54-8b4c-79e217235c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:09.662117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-31a4eac0-527c-4a54-8b4c-79e217235c20 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:09.663912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-31a4eac0-527c-4a54-8b4c-79e217235c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:09.736063 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1099/2209] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:09.744339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb90a01-2093-44c8-b090-3b25119556ff None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:09.744646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb90a01-2093-44c8-b090-3b25119556ff None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:09.744936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb90a01-2093-44c8-b090-3b25119556ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:09.769691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-cdb90a01-2093-44c8-b090-3b25119556ff None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:09.769691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-cdb90a01-2093-44c8-b090-3b25119556ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:09.778592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1111/2210] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:09.783061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4eac0-527c-4a54-8b4c-79e217235c20 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:09.792682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4eac0-527c-4a54-8b4c-79e217235c20 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:09.798396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01132f08-9707-4863-b6d5-dbe518f4fcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:09.799090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132f08-9707-4863-b6d5-dbe518f4fcfb admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:09.799387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132f08-9707-4863-b6d5-dbe518f4fcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:09.799662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132f08-9707-4863-b6d5-dbe518f4fcfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:09.800418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01132f08-9707-4863-b6d5-dbe518f4fcfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:41:09.800735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01132f08-9707-4863-b6d5-dbe518f4fcfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:09.802406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01132f08-9707-4863-b6d5-dbe518f4fcfb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:09.825170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1100/2211] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:41:09.825433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb90a01-2093-44c8-b090-3b25119556ff None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:09.833783 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb90a01-2093-44c8-b090-3b25119556ff None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:09.845571 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431d154-ca30-4da8-b408-dd4648780c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:09.846268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431d154-ca30-4da8-b408-dd4648780c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:09.846714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431d154-ca30-4da8-b408-dd4648780c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:09.847004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431d154-ca30-4da8-b408-dd4648780c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:09.847717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431d154-ca30-4da8-b408-dd4648780c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:09.850055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431d154-ca30-4da8-b408-dd4648780c94 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:09.989736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1112/2212] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:41:09 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:41:09.990020 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01132f08-9707-4863-b6d5-dbe518f4fcfb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:10.006329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01132f08-9707-4863-b6d5-dbe518f4fcfb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:10.078098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfb586-44b1-4adf-b957-e249bb7d868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:10.078774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfb586-44b1-4adf-b957-e249bb7d868f admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:10.079061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfb586-44b1-4adf-b957-e249bb7d868f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:10.079338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfb586-44b1-4adf-b957-e249bb7d868f admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:10.080026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfb586-44b1-4adf-b957-e249bb7d868f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:10.081975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfb586-44b1-4adf-b957-e249bb7d868f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:10.184047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1101/2213] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:41:09 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:41:10.189130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431d154-ca30-4da8-b408-dd4648780c94 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:10.199619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431d154-ca30-4da8-b408-dd4648780c94 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:10.204759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f35c60-510e-4059-aa20-d638d41a07a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:10.205477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35c60-510e-4059-aa20-d638d41a07a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:10.205812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35c60-510e-4059-aa20-d638d41a07a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:10.206190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35c60-510e-4059-aa20-d638d41a07a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:10.206915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f35c60-510e-4059-aa20-d638d41a07a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:10.208684 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f35c60-510e-4059-aa20-d638d41a07a3 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:10.220312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1113/2214] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:41:10.224025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfb586-44b1-4adf-b957-e249bb7d868f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:10.234164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfb586-44b1-4adf-b957-e249bb7d868f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:10.238922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53e097-6020-4c8a-83e6-a04a444b55eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:10.244891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e097-6020-4c8a-83e6-a04a444b55eb admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:10.244891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e097-6020-4c8a-83e6-a04a444b55eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:10.244891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e097-6020-4c8a-83e6-a04a444b55eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:10.244891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53e097-6020-4c8a-83e6-a04a444b55eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:10.244891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53e097-6020-4c8a-83e6-a04a444b55eb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:10.253309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1102/2215] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:41:10.257401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f35c60-510e-4059-aa20-d638d41a07a3 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:10.268101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f35c60-510e-4059-aa20-d638d41a07a3 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:10.272877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b8cef-617a-47a6-bff1-56255cfdf08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:10.273834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b8cef-617a-47a6-bff1-56255cfdf08d admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:10.274115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b8cef-617a-47a6-bff1-56255cfdf08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:10.274392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b8cef-617a-47a6-bff1-56255cfdf08d admin admin] PATH_INFO: `/v3/projects/2ff39ac694af4f98aae20d074d3277b5/users/4558fd4ea73144f895966b775b97a98a/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:10.291093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b8cef-617a-47a6-bff1-56255cfdf08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff39ac694af4f98aae20d074d3277b5, user_id=4558fd4ea73144f895966b775b97a98a, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:10.293842 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b8cef-617a-47a6-bff1-56255cfdf08d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:10.394393 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1114/2216] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:41:10 2022] PUT /identity/v3/projects/2ff39ac694af4f98aae20d074d3277b5/users/4558fd4ea73144f895966b775b97a98a/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:10.405194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf831d-a329-4ce0-b314-810ebc37c41e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:10.405601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf831d-a329-4ce0-b314-810ebc37c41e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:10.405965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf831d-a329-4ce0-b314-810ebc37c41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:10.448111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e1cf831d-a329-4ce0-b314-810ebc37c41e None None] MFA Rules not processed for user `4558fd4ea73144f895966b775b97a98a`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:10.449612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e1cf831d-a329-4ce0-b314-810ebc37c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:10.544522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1103/2217] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:41:10.552771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b8cef-617a-47a6-bff1-56255cfdf08d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:10.554545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-711b8cef-617a-47a6-bff1-56255cfdf08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:10.667266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b8cef-617a-47a6-bff1-56255cfdf08d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:10.674027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d6558-b85a-4e2e-a99e-99ac335eec59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:10.676592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d6558-b85a-4e2e-a99e-99ac335eec59 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:10.676945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d6558-b85a-4e2e-a99e-99ac335eec59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:10.677232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d6558-b85a-4e2e-a99e-99ac335eec59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:10.694632 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d6558-b85a-4e2e-a99e-99ac335eec59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:10.696298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d6558-b85a-4e2e-a99e-99ac335eec59 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:10.728654 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1115/2218] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:41:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:41:15.435892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f82a-0cef-428c-8630-4608ec561a1d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:15.435892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f82a-0cef-428c-8630-4608ec561a1d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:15.435892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f82a-0cef-428c-8630-4608ec561a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:15.454645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-26f1f82a-0cef-428c-8630-4608ec561a1d None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:15.455859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-26f1f82a-0cef-428c-8630-4608ec561a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:15.510446 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1104/2219] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 12 20:41:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:15.522877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d6558-b85a-4e2e-a99e-99ac335eec59 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:15.524293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-841d6558-b85a-4e2e-a99e-99ac335eec59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:15.603487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d6558-b85a-4e2e-a99e-99ac335eec59 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:15.609804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b54ddc-273b-4298-9108-a7e3f3c1da8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:15.612961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b54ddc-273b-4298-9108-a7e3f3c1da8b service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:15.612961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b54ddc-273b-4298-9108-a7e3f3c1da8b service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:15.612961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b54ddc-273b-4298-9108-a7e3f3c1da8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:15.619697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b54ddc-273b-4298-9108-a7e3f3c1da8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:15.621338 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b54ddc-273b-4298-9108-a7e3f3c1da8b service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:15.631044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1116/2220] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:41:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:41:37.505466 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9147f-c762-4844-8817-48dc5ecf4d75 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:37.505975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9147f-c762-4844-8817-48dc5ecf4d75 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:37.506079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9147f-c762-4844-8817-48dc5ecf4d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:37.525013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-36c9147f-c762-4844-8817-48dc5ecf4d75 None None] MFA Rules not processed for user `2a2b95ccb7804311a011f37ccb371771`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:37.526224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-36c9147f-c762-4844-8817-48dc5ecf4d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:37.580691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1105/2221] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:54.920030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b54ddc-273b-4298-9108-a7e3f3c1da8b service swift] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:54.982371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b54ddc-273b-4298-9108-a7e3f3c1da8b service swift] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:54.987397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:54.988304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:54.988593 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:54.988874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] PATH_INFO: `/v3/users/4558fd4ea73144f895966b775b97a98a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:54.990162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4558fd4ea73144f895966b775b97a98a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:54.992350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:55.309753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4558fd4ea73144f895966b775b97a98a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:55.310509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4558fd4ea73144f895966b775b97a98a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:55.311199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4558fd4ea73144f895966b775b97a98a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:55.324043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4558fd4ea73144f895966b775b97a98a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:55.330860 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4558fd4ea73144f895966b775b97a98a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:55.463864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1117/2222] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:41:54 2022] DELETE /identity/v3/users/4558fd4ea73144f895966b775b97a98a => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:55.468484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958a289-53f3-4ba7-8f69-7bef41ed0db6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:55.472242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958a289-53f3-4ba7-8f69-7bef41ed0db6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:55.472242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958a289-53f3-4ba7-8f69-7bef41ed0db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:55.487245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-f958a289-53f3-4ba7-8f69-7bef41ed0db6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:55.488466 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f958a289-53f3-4ba7-8f69-7bef41ed0db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:55.547068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1106/2223] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:55.556933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:55.558412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:55.614883 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be18f96-a53c-4850-b3aa-6d5bee66e4c0 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:55.619546 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ef76e-0178-4778-87ca-679f3a755546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:55.620190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ef76e-0178-4778-87ca-679f3a755546 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:55.620474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ef76e-0178-4778-87ca-679f3a755546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:55.620752 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ef76e-0178-4778-87ca-679f3a755546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:55.629523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ef76e-0178-4778-87ca-679f3a755546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:55.631191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ef76e-0178-4778-87ca-679f3a755546 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:55.641536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1118/2224] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:41:56.064741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958a289-53f3-4ba7-8f69-7bef41ed0db6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:56.067329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f958a289-53f3-4ba7-8f69-7bef41ed0db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:56.081916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958a289-53f3-4ba7-8f69-7bef41ed0db6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:56.088796 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:56.089824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:56.090023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:56.090295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] PATH_INFO: `/v3/projects/2ff39ac694af4f98aae20d074d3277b5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:56.097028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff39ac694af4f98aae20d074d3277b5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:56.099201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:56.224054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff39ac694af4f98aae20d074d3277b5', 'request_id': 'req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:56.230216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff39ac694af4f98aae20d074d3277b5', 'request_id': 'req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:56.309062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff39ac694af4f98aae20d074d3277b5', 'request_id': 'req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:56.321846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] The token cache is being invalidate because project 2ff39ac694af4f98aae20d074d3277b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:41:56.322040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:56.322714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f74cd1fa-b59c-4843-acdf-b96064c7ecfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:56.324457 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1107/2225] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:41:56 2022] DELETE /identity/v3/projects/2ff39ac694af4f98aae20d074d3277b5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:56.329121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5a9e8-7402-4d7d-b303-ae3bd6a1bdd8 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:56.329663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5a9e8-7402-4d7d-b303-ae3bd6a1bdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:56.329774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5a9e8-7402-4d7d-b303-ae3bd6a1bdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:56.350539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-34b5a9e8-7402-4d7d-b303-ae3bd6a1bdd8 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:56.352598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-34b5a9e8-7402-4d7d-b303-ae3bd6a1bdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:56.421157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1119/2226] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:56.429345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9a691-3f19-4bbc-b7e9-5c6e0d3ed37d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:56.429929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9a691-3f19-4bbc-b7e9-5c6e0d3ed37d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:56.431112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9a691-3f19-4bbc-b7e9-5c6e0d3ed37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:56.456988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ada9a691-3f19-4bbc-b7e9-5c6e0d3ed37d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:56.458337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ada9a691-3f19-4bbc-b7e9-5c6e0d3ed37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:56.477759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1108/2227] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:41:56.482007 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5a9e8-7402-4d7d-b303-ae3bd6a1bdd8 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:56.502545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5a9e8-7402-4d7d-b303-ae3bd6a1bdd8 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:56.502545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423b875-a242-4649-b310-85a27944e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:56.502545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423b875-a242-4649-b310-85a27944e79a admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:56.502545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423b875-a242-4649-b310-85a27944e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:56.502964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423b875-a242-4649-b310-85a27944e79a admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:56.502964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423b875-a242-4649-b310-85a27944e79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:41:56.502964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423b875-a242-4649-b310-85a27944e79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:56.502964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423b875-a242-4649-b310-85a27944e79a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:56.514460 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1120/2228] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:41:56.518971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9a691-3f19-4bbc-b7e9-5c6e0d3ed37d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:56.529070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9a691-3f19-4bbc-b7e9-5c6e0d3ed37d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:56.533876 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40dec2-8392-44af-872f-9e6fd5ae3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:56.538599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40dec2-8392-44af-872f-9e6fd5ae3763 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:56.538599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40dec2-8392-44af-872f-9e6fd5ae3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:56.538599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40dec2-8392-44af-872f-9e6fd5ae3763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:56.538599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40dec2-8392-44af-872f-9e6fd5ae3763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:56.538599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40dec2-8392-44af-872f-9e6fd5ae3763 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:56.665557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1109/2229] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:41:56 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:41:56.669514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423b875-a242-4649-b310-85a27944e79a admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:56.679668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423b875-a242-4649-b310-85a27944e79a admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:56.735829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f8aa1-d342-42b5-8659-863d7058001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:56.736505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f8aa1-d342-42b5-8659-863d7058001c admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:56.736789 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f8aa1-d342-42b5-8659-863d7058001c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:56.737066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f8aa1-d342-42b5-8659-863d7058001c admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:56.737802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f8aa1-d342-42b5-8659-863d7058001c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:56.739745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f8aa1-d342-42b5-8659-863d7058001c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:56.836401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1121/2230] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:41:56 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:41:56.840680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40dec2-8392-44af-872f-9e6fd5ae3763 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:56.851598 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40dec2-8392-44af-872f-9e6fd5ae3763 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:56.860100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89ed3c-c466-474b-8ef2-c376a9ca6c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:56.860100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89ed3c-c466-474b-8ef2-c376a9ca6c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:56.860426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89ed3c-c466-474b-8ef2-c376a9ca6c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:56.860798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89ed3c-c466-474b-8ef2-c376a9ca6c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:56.861680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89ed3c-c466-474b-8ef2-c376a9ca6c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:56.863551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89ed3c-c466-474b-8ef2-c376a9ca6c01 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:56.875938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1110/2231] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:41:56.880604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f8aa1-d342-42b5-8659-863d7058001c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:56.892435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f8aa1-d342-42b5-8659-863d7058001c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:56.897055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1761671-5580-477f-9b83-4433035bb26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:56.897764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1761671-5580-477f-9b83-4433035bb26e admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:56.898055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1761671-5580-477f-9b83-4433035bb26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:56.898333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1761671-5580-477f-9b83-4433035bb26e admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:56.899060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1761671-5580-477f-9b83-4433035bb26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:56.900641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1761671-5580-477f-9b83-4433035bb26e admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:56.910586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1122/2232] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:41:56.914910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89ed3c-c466-474b-8ef2-c376a9ca6c01 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:56.924891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89ed3c-c466-474b-8ef2-c376a9ca6c01 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:56.930107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97204f-58d3-45af-ab85-2129c1c0405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:56.930995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97204f-58d3-45af-ab85-2129c1c0405e admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:56.931278 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97204f-58d3-45af-ab85-2129c1c0405e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:56.931560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97204f-58d3-45af-ab85-2129c1c0405e admin admin] PATH_INFO: `/v3/projects/1c57bfc81e334d3ca8354aada21303f7/users/a2466b785524488db15ec453e90d3ddf/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:56.946585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97204f-58d3-45af-ab85-2129c1c0405e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c57bfc81e334d3ca8354aada21303f7, user_id=a2466b785524488db15ec453e90d3ddf, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:56.949221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97204f-58d3-45af-ab85-2129c1c0405e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:57.034742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1111/2233] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:41:56 2022] PUT /identity/v3/projects/1c57bfc81e334d3ca8354aada21303f7/users/a2466b785524488db15ec453e90d3ddf/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:57.045533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71a8c-d28e-4d32-96c8-f543546fa40a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:57.045824 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71a8c-d28e-4d32-96c8-f543546fa40a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:57.046101 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71a8c-d28e-4d32-96c8-f543546fa40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:57.072952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8ef71a8c-d28e-4d32-96c8-f543546fa40a None None] MFA Rules not processed for user `a2466b785524488db15ec453e90d3ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:57.074179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8ef71a8c-d28e-4d32-96c8-f543546fa40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:57.136510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1123/2234] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:57.147738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97204f-58d3-45af-ab85-2129c1c0405e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:57.149757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ca97204f-58d3-45af-ab85-2129c1c0405e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:57.211593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97204f-58d3-45af-ab85-2129c1c0405e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:57.215209 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157a2f8-529f-4894-9482-fc618949e09c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:57.215854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a2f8-529f-4894-9482-fc618949e09c service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:57.216141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a2f8-529f-4894-9482-fc618949e09c service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:57.216443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a2f8-529f-4894-9482-fc618949e09c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:57.224825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157a2f8-529f-4894-9482-fc618949e09c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:57.227407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157a2f8-529f-4894-9482-fc618949e09c service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:57.236155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1112/2235] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:41:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:41:57.263064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71a8c-d28e-4d32-96c8-f543546fa40a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:57.323044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71a8c-d28e-4d32-96c8-f543546fa40a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:57.327622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:57.328479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:57.328763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:57.329038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] PATH_INFO: `/v3/users/a2466b785524488db15ec453e90d3ddf` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:57.330278 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2466b785524488db15ec453e90d3ddf)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:57.332334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:57.592344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2466b785524488db15ec453e90d3ddf'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:57.593139 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2466b785524488db15ec453e90d3ddf'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:57.593806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2466b785524488db15ec453e90d3ddf'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:57.607654 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2466b785524488db15ec453e90d3ddf'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:57.614474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2466b785524488db15ec453e90d3ddf'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:57.686776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1124/2236] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:41:57 2022] DELETE /identity/v3/users/a2466b785524488db15ec453e90d3ddf => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:57.691257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa6b7c-d36c-4fda-9e8b-28a0727bebea None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:57.691787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa6b7c-d36c-4fda-9e8b-28a0727bebea None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:57.691885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa6b7c-d36c-4fda-9e8b-28a0727bebea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:57.710370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-21fa6b7c-d36c-4fda-9e8b-28a0727bebea None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:57.711647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-21fa6b7c-d36c-4fda-9e8b-28a0727bebea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:57.769309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1113/2237] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:41:57.779146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:57.780528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:57.838416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576c5ff-84ba-4b56-baca-6fe2a79ae6e4 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:57.841970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cad7a-8b84-494b-8315-f9067c5df5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:57.842608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cad7a-8b84-494b-8315-f9067c5df5ba service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:57.842927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cad7a-8b84-494b-8315-f9067c5df5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:57.843203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cad7a-8b84-494b-8315-f9067c5df5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:57.852376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cad7a-8b84-494b-8315-f9067c5df5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:57.854127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cad7a-8b84-494b-8315-f9067c5df5ba service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:57.864120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1125/2238] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:41:58.426161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa6b7c-d36c-4fda-9e8b-28a0727bebea None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:58.427692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-21fa6b7c-d36c-4fda-9e8b-28a0727bebea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:58.439671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa6b7c-d36c-4fda-9e8b-28a0727bebea None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:58.444607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:58.445647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:58.446301 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:58.446581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] PATH_INFO: `/v3/projects/1c57bfc81e334d3ca8354aada21303f7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:58.447851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c57bfc81e334d3ca8354aada21303f7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:58.449917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:58.575249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c57bfc81e334d3ca8354aada21303f7', 'request_id': 'req-23b704b6-7421-47c1-bac8-624d09b3fa47'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:58.582783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c57bfc81e334d3ca8354aada21303f7', 'request_id': 'req-23b704b6-7421-47c1-bac8-624d09b3fa47'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:58.680476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c57bfc81e334d3ca8354aada21303f7', 'request_id': 'req-23b704b6-7421-47c1-bac8-624d09b3fa47'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:58.695646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] The token cache is being invalidate because project 1c57bfc81e334d3ca8354aada21303f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:41:58.696373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:58.696613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-23b704b6-7421-47c1-bac8-624d09b3fa47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:41:58.698334 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1114/2239] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:41:58 2022] DELETE /identity/v3/projects/1c57bfc81e334d3ca8354aada21303f7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:41:58.703971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e9563-bb43-4277-a509-d61bb79a58d5 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:58.704524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e9563-bb43-4277-a509-d61bb79a58d5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:58.704730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e9563-bb43-4277-a509-d61bb79a58d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:58.759227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-652e9563-bb43-4277-a509-d61bb79a58d5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:58.760413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-652e9563-bb43-4277-a509-d61bb79a58d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:58.837131 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1126/2240] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:58.844875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21681245-ac42-4893-9469-e6d33f7a7d81 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:58.845299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21681245-ac42-4893-9469-e6d33f7a7d81 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:58.845656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21681245-ac42-4893-9469-e6d33f7a7d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:58.865873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-21681245-ac42-4893-9469-e6d33f7a7d81 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:58.867753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-21681245-ac42-4893-9469-e6d33f7a7d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:58.879595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1115/2241] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:41:58.888676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e9563-bb43-4277-a509-d61bb79a58d5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:58.899780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e9563-bb43-4277-a509-d61bb79a58d5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:58.905386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d35e-6d7a-4f53-b637-3008cc0f3562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:58.906069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d35e-6d7a-4f53-b637-3008cc0f3562 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:58.906352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d35e-6d7a-4f53-b637-3008cc0f3562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:58.906631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d35e-6d7a-4f53-b637-3008cc0f3562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:58.907672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17d35e-6d7a-4f53-b637-3008cc0f3562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:41:58.908037 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17d35e-6d7a-4f53-b637-3008cc0f3562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:58.909768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17d35e-6d7a-4f53-b637-3008cc0f3562 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:58.923446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1127/2242] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:41:58.927598 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21681245-ac42-4893-9469-e6d33f7a7d81 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:58.941195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21681245-ac42-4893-9469-e6d33f7a7d81 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:58.947851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28055269-b595-44d6-a06d-46e2cc7a4038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:58.948518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28055269-b595-44d6-a06d-46e2cc7a4038 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:58.948802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28055269-b595-44d6-a06d-46e2cc7a4038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:58.949099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28055269-b595-44d6-a06d-46e2cc7a4038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:58.950408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28055269-b595-44d6-a06d-46e2cc7a4038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:58.952324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28055269-b595-44d6-a06d-46e2cc7a4038 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:59.066274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1116/2243] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:41:58 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:41:59.072089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d35e-6d7a-4f53-b637-3008cc0f3562 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:59.082091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d35e-6d7a-4f53-b637-3008cc0f3562 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:59.149774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6132a2-74e7-4509-8379-1d2378fda687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:59.149774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6132a2-74e7-4509-8379-1d2378fda687 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:59.149774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6132a2-74e7-4509-8379-1d2378fda687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:59.149774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6132a2-74e7-4509-8379-1d2378fda687 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:59.150460 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6132a2-74e7-4509-8379-1d2378fda687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:59.152555 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6132a2-74e7-4509-8379-1d2378fda687 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:59.249890 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1128/2244] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:41:59 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:41:59.254217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28055269-b595-44d6-a06d-46e2cc7a4038 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:59.264794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28055269-b595-44d6-a06d-46e2cc7a4038 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:59.269623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eb483-5a98-4b0e-ae5a-77b47dc2763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:59.270295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eb483-5a98-4b0e-ae5a-77b47dc2763b admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:59.270588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eb483-5a98-4b0e-ae5a-77b47dc2763b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:59.270869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eb483-5a98-4b0e-ae5a-77b47dc2763b admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:59.271633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eb483-5a98-4b0e-ae5a-77b47dc2763b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:59.273865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eb483-5a98-4b0e-ae5a-77b47dc2763b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:59.284303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1117/2245] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:41:59.288218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6132a2-74e7-4509-8379-1d2378fda687 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:59.298855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6132a2-74e7-4509-8379-1d2378fda687 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:59.303471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1f1bb-e8dc-4d8f-af7f-9922af42e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:59.304148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f1bb-e8dc-4d8f-af7f-9922af42e5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:59.304445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f1bb-e8dc-4d8f-af7f-9922af42e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:59.304812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f1bb-e8dc-4d8f-af7f-9922af42e5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:59.305659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f1bb-e8dc-4d8f-af7f-9922af42e5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:59.307243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f1bb-e8dc-4d8f-af7f-9922af42e5b2 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:59.316997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1129/2246] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:41:59.321132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eb483-5a98-4b0e-ae5a-77b47dc2763b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:59.331384 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eb483-5a98-4b0e-ae5a-77b47dc2763b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:59.336822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8e554-da23-4167-b5fc-5dc239161c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:59.337734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8e554-da23-4167-b5fc-5dc239161c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:59.338025 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8e554-da23-4167-b5fc-5dc239161c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:59.338307 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8e554-da23-4167-b5fc-5dc239161c4b admin admin] PATH_INFO: `/v3/projects/b2494c982e7f45cba3b28a0ccdf3a83f/users/9740039be9644eb58b3a12eb021e287d/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:59.354012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8e554-da23-4167-b5fc-5dc239161c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2494c982e7f45cba3b28a0ccdf3a83f, user_id=9740039be9644eb58b3a12eb021e287d, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:59.356728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8e554-da23-4167-b5fc-5dc239161c4b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:59.453245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1118/2247] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:41:59 2022] PUT /identity/v3/projects/b2494c982e7f45cba3b28a0ccdf3a83f/users/9740039be9644eb58b3a12eb021e287d/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:41:59.466561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d69452-8969-49d9-bb79-56f3f989041d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:59.467562 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d69452-8969-49d9-bb79-56f3f989041d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:59.472559 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d69452-8969-49d9-bb79-56f3f989041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:59.504891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-99d69452-8969-49d9-bb79-56f3f989041d None None] MFA Rules not processed for user `9740039be9644eb58b3a12eb021e287d`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:41:59.506480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-99d69452-8969-49d9-bb79-56f3f989041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:59.590077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1130/2248] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:41:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:41:59.602892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8e554-da23-4167-b5fc-5dc239161c4b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:41:59.606041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-81c8e554-da23-4167-b5fc-5dc239161c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:41:59.673898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8e554-da23-4167-b5fc-5dc239161c4b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:41:59.677780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c515f-740c-4d79-8256-e0267054f4b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:41:59.678439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c515f-740c-4d79-8256-e0267054f4b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:41:59.678777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c515f-740c-4d79-8256-e0267054f4b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:41:59.679061 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c515f-740c-4d79-8256-e0267054f4b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:41:59.687986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c515f-740c-4d79-8256-e0267054f4b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:41:59.689466 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c515f-740c-4d79-8256-e0267054f4b7 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:41:59.700941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1119/2249] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:41:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:42:01.410997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cccffd-89d5-4550-92c3-92c8b394b52b None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:01.411494 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cccffd-89d5-4550-92c3-92c8b394b52b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:01.411606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cccffd-89d5-4550-92c3-92c8b394b52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:01.429028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d2cccffd-89d5-4550-92c3-92c8b394b52b None None] MFA Rules not processed for user `9740039be9644eb58b3a12eb021e287d`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:01.430325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d2cccffd-89d5-4550-92c3-92c8b394b52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:01.436977 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1131/2250] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:42:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:42:05.300430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c92a-3794-4744-9070-0901080e44c3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:05.301434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c92a-3794-4744-9070-0901080e44c3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:05.301972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c92a-3794-4744-9070-0901080e44c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:05.323018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a3b5c92a-3794-4744-9070-0901080e44c3 None None] MFA Rules not processed for user `606b53c6f60d45cf9e2c3e5c6c9cde2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:05.324349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a3b5c92a-3794-4744-9070-0901080e44c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:05.396172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1120/2251] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:42:19.945551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6acff-1c76-4504-8504-04893cc13406 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:19.945551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6acff-1c76-4504-8504-04893cc13406 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:19.946496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6acff-1c76-4504-8504-04893cc13406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:19.965910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d5f6acff-1c76-4504-8504-04893cc13406 None None] MFA Rules not processed for user `64ce721d7163430dbf31ffbbf28c2094`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:19.967144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d5f6acff-1c76-4504-8504-04893cc13406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:20.019975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1132/2252] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:42:20.658752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d1b3-de8b-44ff-b437-92c5bca33512 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:20.659267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d1b3-de8b-44ff-b437-92c5bca33512 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:20.659358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d1b3-de8b-44ff-b437-92c5bca33512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:20.679892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4af6d1b3-de8b-44ff-b437-92c5bca33512 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:20.681137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4af6d1b3-de8b-44ff-b437-92c5bca33512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:20.745680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1121/2253] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:42:20.914641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6acff-1c76-4504-8504-04893cc13406 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:20.914641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d5f6acff-1c76-4504-8504-04893cc13406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:20.985622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6acff-1c76-4504-8504-04893cc13406 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:20.990911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efe474-6f01-4936-89cc-ac821032de13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:20.992080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe474-6f01-4936-89cc-ac821032de13 service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:20.992492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe474-6f01-4936-89cc-ac821032de13 service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:20.992740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe474-6f01-4936-89cc-ac821032de13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:21.001150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efe474-6f01-4936-89cc-ac821032de13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:21.002766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efe474-6f01-4936-89cc-ac821032de13 service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:21.012279 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1133/2254] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:42:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:42:21.971068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4431ea-c041-41f4-9f47-70810c65cbed None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:21.972748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4431ea-c041-41f4-9f47-70810c65cbed None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:21.972748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4431ea-c041-41f4-9f47-70810c65cbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:21.990665 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1f4431ea-c041-41f4-9f47-70810c65cbed None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:21.992041 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1f4431ea-c041-41f4-9f47-70810c65cbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:21.999535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1122/2255] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 12 20:42:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:42:22.013013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efe474-6f01-4936-89cc-ac821032de13 service swift] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:22.023891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efe474-6f01-4936-89cc-ac821032de13 service swift] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:22.029040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10905f10-10c9-41a9-87a6-c59fc98daf77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:22.029710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10905f10-10c9-41a9-87a6-c59fc98daf77 service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:22.029993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10905f10-10c9-41a9-87a6-c59fc98daf77 service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:22.030271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10905f10-10c9-41a9-87a6-c59fc98daf77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:22.038238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10905f10-10c9-41a9-87a6-c59fc98daf77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:22.039976 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10905f10-10c9-41a9-87a6-c59fc98daf77 service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:22.048410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1134/2256] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:42:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 20:42:22.676489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cae962-4eac-4c4c-a735-6584225df7a6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:22.676800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cae962-4eac-4c4c-a735-6584225df7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:22.677060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cae962-4eac-4c4c-a735-6584225df7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:22.696632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-99cae962-4eac-4c4c-a735-6584225df7a6 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:22.697888 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-99cae962-4eac-4c4c-a735-6584225df7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:22.706011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1123/2257] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:42:22.718587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10905f10-10c9-41a9-87a6-c59fc98daf77 service swift] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:22.729501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10905f10-10c9-41a9-87a6-c59fc98daf77 service swift] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:22.736883 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b0204-7437-4302-9c71-abbf1936b6d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:22.737061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0204-7437-4302-9c71-abbf1936b6d3 service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:22.737297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0204-7437-4302-9c71-abbf1936b6d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:22.737596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0204-7437-4302-9c71-abbf1936b6d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:22.748749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b0204-7437-4302-9c71-abbf1936b6d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:22.750389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b0204-7437-4302-9c71-abbf1936b6d3 service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:22.761345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1135/2258] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:42:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:42:23.370337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faab9d-3070-42cc-8e96-fd7922e77593 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:23.370753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faab9d-3070-42cc-8e96-fd7922e77593 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:23.370903 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faab9d-3070-42cc-8e96-fd7922e77593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:23.388429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-22faab9d-3070-42cc-8e96-fd7922e77593 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:23.389760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-22faab9d-3070-42cc-8e96-fd7922e77593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:23.397302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1124/2259] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 12 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:42:23.412493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b0204-7437-4302-9c71-abbf1936b6d3 service swift] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:23.425830 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b0204-7437-4302-9c71-abbf1936b6d3 service swift] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:23.431388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f5f3f-9fb0-4436-b670-a1c2bd1a0a7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:23.432056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5f3f-9fb0-4436-b670-a1c2bd1a0a7e service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:23.435688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5f3f-9fb0-4436-b670-a1c2bd1a0a7e service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:23.435688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5f3f-9fb0-4436-b670-a1c2bd1a0a7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:23.441072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f5f3f-9fb0-4436-b670-a1c2bd1a0a7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:23.442712 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f5f3f-9fb0-4436-b670-a1c2bd1a0a7e service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:23.451301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1136/2260] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:42:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 20:42:26.259408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faab9d-3070-42cc-8e96-fd7922e77593 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:26.343162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faab9d-3070-42cc-8e96-fd7922e77593 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:26.348296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:26.349093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:26.349415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:26.349700 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] PATH_INFO: `/v3/users/9740039be9644eb58b3a12eb021e287d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:26.350888 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9740039be9644eb58b3a12eb021e287d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:26.353469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:26.560340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9740039be9644eb58b3a12eb021e287d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:26.574305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9740039be9644eb58b3a12eb021e287d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:26.575525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9740039be9644eb58b3a12eb021e287d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:26.636414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9740039be9644eb58b3a12eb021e287d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:26.652232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9740039be9644eb58b3a12eb021e287d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:26.660919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1125/2261] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:42:26 2022] DELETE /identity/v3/users/9740039be9644eb58b3a12eb021e287d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:42:26.666144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c1e6-6173-4a33-a1ff-08354c6d2ee5 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:26.667090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c1e6-6173-4a33-a1ff-08354c6d2ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:26.667718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c1e6-6173-4a33-a1ff-08354c6d2ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:26.705970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-11a1c1e6-6173-4a33-a1ff-08354c6d2ee5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:26.707229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-11a1c1e6-6173-4a33-a1ff-08354c6d2ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:26.804580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1137/2262] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:42:26.813242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:26.815534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:26.926331 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc703b-c17f-437d-8bd1-7f9f2284c2e5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:26.931440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc42111-d0a6-46c9-90f1-73d3dfb72705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:26.932353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc42111-d0a6-46c9-90f1-73d3dfb72705 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:26.932803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc42111-d0a6-46c9-90f1-73d3dfb72705 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:26.933263 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc42111-d0a6-46c9-90f1-73d3dfb72705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:26.943743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc42111-d0a6-46c9-90f1-73d3dfb72705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:26.945254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc42111-d0a6-46c9-90f1-73d3dfb72705 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:26.956510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1126/2263] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:42:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:42:27.191576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1c1e6-6173-4a33-a1ff-08354c6d2ee5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:27.193036 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-11a1c1e6-6173-4a33-a1ff-08354c6d2ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:27.205929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1c1e6-6173-4a33-a1ff-08354c6d2ee5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:27.225791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:27.226689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:27.229719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:27.230028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] PATH_INFO: `/v3/projects/b2494c982e7f45cba3b28a0ccdf3a83f` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:27.231297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2494c982e7f45cba3b28a0ccdf3a83f)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:27.233527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:27.331738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'request_id': 'req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:27.337626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'request_id': 'req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:27.420840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'request_id': 'req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:27.432922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] The token cache is being invalidate because project b2494c982e7f45cba3b28a0ccdf3a83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:42:27.433242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:27.433901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:27.435474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1138/2264] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:42:27 2022] DELETE /identity/v3/projects/b2494c982e7f45cba3b28a0ccdf3a83f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:42:53.511495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc42111-d0a6-46c9-90f1-73d3dfb72705 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:53.513071 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-abc42111-d0a6-46c9-90f1-73d3dfb72705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:53.527100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc42111-d0a6-46c9-90f1-73d3dfb72705 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:53.583082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:53.583865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:53.584152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:53.584433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] PATH_INFO: `/v3/users/2a2b95ccb7804311a011f37ccb371771` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:53.585704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2b95ccb7804311a011f37ccb371771)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:53.588218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:53.761099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2b95ccb7804311a011f37ccb371771'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:53.773159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2b95ccb7804311a011f37ccb371771'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:53.775018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2b95ccb7804311a011f37ccb371771'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:53.848559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2b95ccb7804311a011f37ccb371771'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:53.856056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b6de1d4-be52-49a5-9e93-dc6b1ed66663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2b95ccb7804311a011f37ccb371771'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:53.862138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1127/2265] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:42:53 2022] DELETE /identity/v3/users/2a2b95ccb7804311a011f37ccb371771 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:42:54.115551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:54.118503 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:54.131182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daadb7-2d5b-4b8a-9547-5b4544bb9d34 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:54.190355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:54.191218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.191502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.191780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] PATH_INFO: `/v3/projects/500b58188f1a4a088b52b67eb5772984` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.193090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500b58188f1a4a088b52b67eb5772984)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:54.198431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:54.202509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7673c6-e40f-4147-a872-95392c58e78e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.202863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7673c6-e40f-4147-a872-95392c58e78e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.203351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7673c6-e40f-4147-a872-95392c58e78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.224082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8d7673c6-e40f-4147-a872-95392c58e78e None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:54.225335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8d7673c6-e40f-4147-a872-95392c58e78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:54.280397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1128/2266] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 12 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:42:54.294371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7673c6-e40f-4147-a872-95392c58e78e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:54.295804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8d7673c6-e40f-4147-a872-95392c58e78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:54.313834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500b58188f1a4a088b52b67eb5772984', 'request_id': 'req-4c57ffb0-3765-47be-a5fc-f070faa1ab92'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:54.319303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500b58188f1a4a088b52b67eb5772984', 'request_id': 'req-4c57ffb0-3765-47be-a5fc-f070faa1ab92'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:54.364461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7673c6-e40f-4147-a872-95392c58e78e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:54.382578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500b58188f1a4a088b52b67eb5772984', 'request_id': 'req-4c57ffb0-3765-47be-a5fc-f070faa1ab92'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:54.394371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] The token cache is being invalidate because project 500b58188f1a4a088b52b67eb5772984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:42:54.396563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:54.396563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-4c57ffb0-3765-47be-a5fc-f070faa1ab92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:42:54.396898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1139/2267] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:42:54 2022] DELETE /identity/v3/projects/500b58188f1a4a088b52b67eb5772984 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:42:54.401719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cd7ad-65ed-487b-a3ce-8f6627881d41 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.402089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cd7ad-65ed-487b-a3ce-8f6627881d41 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.402445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cd7ad-65ed-487b-a3ce-8f6627881d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.420564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-b60cd7ad-65ed-487b-a3ce-8f6627881d41 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:54.421826 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b60cd7ad-65ed-487b-a3ce-8f6627881d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:54.424739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fb082-e46e-4e90-bd3f-d0be906eaaff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:54.425426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb082-e46e-4e90-bd3f-d0be906eaaff service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.425714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb082-e46e-4e90-bd3f-d0be906eaaff service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.425994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fb082-e46e-4e90-bd3f-d0be906eaaff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.427798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c08fb082-e46e-4e90-bd3f-d0be906eaaff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:54.481171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1140/2268] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:42:54.485782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fb082-e46e-4e90-bd3f-d0be906eaaff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:54.487390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fb082-e46e-4e90-bd3f-d0be906eaaff service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:54.488902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a553-c5fc-4f31-9cd1-f83a221c969e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.489192 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a553-c5fc-4f31-9cd1-f83a221c969e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.489517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a553-c5fc-4f31-9cd1-f83a221c969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.496096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1129/2269] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:42:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 20:42:54.508690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8417a553-c5fc-4f31-9cd1-f83a221c969e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:54.510014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8417a553-c5fc-4f31-9cd1-f83a221c969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:54.518127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1141/2270] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:42:54.522310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fb082-e46e-4e90-bd3f-d0be906eaaff service swift] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:54.533832 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fb082-e46e-4e90-bd3f-d0be906eaaff service swift] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:54.538420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af834a0c-d914-4b8f-9d60-482683c02c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:54.539654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af834a0c-d914-4b8f-9d60-482683c02c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.540168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af834a0c-d914-4b8f-9d60-482683c02c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.540460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af834a0c-d914-4b8f-9d60-482683c02c6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.541191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af834a0c-d914-4b8f-9d60-482683c02c6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:42:54.541540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af834a0c-d914-4b8f-9d60-482683c02c6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:54.543116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af834a0c-d914-4b8f-9d60-482683c02c6c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:54.554318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1130/2271] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:42:54.559285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a553-c5fc-4f31-9cd1-f83a221c969e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:54.568335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a553-c5fc-4f31-9cd1-f83a221c969e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:54.572951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167889f-433a-4314-af48-4a7aaa9aec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:54.573649 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167889f-433a-4314-af48-4a7aaa9aec28 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.573961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167889f-433a-4314-af48-4a7aaa9aec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.574216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167889f-433a-4314-af48-4a7aaa9aec28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.574899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167889f-433a-4314-af48-4a7aaa9aec28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:54.576800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167889f-433a-4314-af48-4a7aaa9aec28 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:54.682251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1142/2272] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:42:54 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:42:54.686586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af834a0c-d914-4b8f-9d60-482683c02c6c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:54.696760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af834a0c-d914-4b8f-9d60-482683c02c6c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:54.751918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96bf63-b72d-46f7-b936-3ee26cf2141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:54.752592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96bf63-b72d-46f7-b936-3ee26cf2141d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.752883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96bf63-b72d-46f7-b936-3ee26cf2141d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.753165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96bf63-b72d-46f7-b936-3ee26cf2141d admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.753918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96bf63-b72d-46f7-b936-3ee26cf2141d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:54.756117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96bf63-b72d-46f7-b936-3ee26cf2141d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:54.851260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1131/2273] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:42:54 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:42:54.856073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167889f-433a-4314-af48-4a7aaa9aec28 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:54.866347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167889f-433a-4314-af48-4a7aaa9aec28 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:54.871106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fd8d8-68bf-49d2-b5ef-12723290e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:54.871769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fd8d8-68bf-49d2-b5ef-12723290e4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.872057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fd8d8-68bf-49d2-b5ef-12723290e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.872337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fd8d8-68bf-49d2-b5ef-12723290e4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.873090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fd8d8-68bf-49d2-b5ef-12723290e4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:54.874777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fd8d8-68bf-49d2-b5ef-12723290e4d5 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:54.885638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1143/2274] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:42:54.895467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96bf63-b72d-46f7-b936-3ee26cf2141d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:54.906449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96bf63-b72d-46f7-b936-3ee26cf2141d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:54.911128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da462f-b87a-4b6f-8754-59371b7a3f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:54.911785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da462f-b87a-4b6f-8754-59371b7a3f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.912072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da462f-b87a-4b6f-8754-59371b7a3f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.912353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da462f-b87a-4b6f-8754-59371b7a3f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.913083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da462f-b87a-4b6f-8754-59371b7a3f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:54.915282 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da462f-b87a-4b6f-8754-59371b7a3f09 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:54.928038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1132/2275] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:42:54.929314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fd8d8-68bf-49d2-b5ef-12723290e4d5 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:54.940013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fd8d8-68bf-49d2-b5ef-12723290e4d5 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:54.944658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38088c6d-822b-4df0-9de8-ea75fcd8f8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:54.946170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38088c6d-822b-4df0-9de8-ea75fcd8f8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:54.946583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38088c6d-822b-4df0-9de8-ea75fcd8f8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:54.946866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38088c6d-822b-4df0-9de8-ea75fcd8f8e9 admin admin] PATH_INFO: `/v3/projects/8fb25cc42cb64f07a42dc479e5a6c5e6/users/c813e15872d84a9bbce3f390df06a0b7/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:54.962107 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38088c6d-822b-4df0-9de8-ea75fcd8f8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb25cc42cb64f07a42dc479e5a6c5e6, user_id=c813e15872d84a9bbce3f390df06a0b7, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:54.964731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38088c6d-822b-4df0-9de8-ea75fcd8f8e9 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:55.060705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1144/2276] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:42:54 2022] PUT /identity/v3/projects/8fb25cc42cb64f07a42dc479e5a6c5e6/users/c813e15872d84a9bbce3f390df06a0b7/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:42:55.071414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925064b-042b-4a3f-9ccc-f95f7ef69a24 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:55.071704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925064b-042b-4a3f-9ccc-f95f7ef69a24 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:55.071984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925064b-042b-4a3f-9ccc-f95f7ef69a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:55.100645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4925064b-042b-4a3f-9ccc-f95f7ef69a24 None None] MFA Rules not processed for user `c813e15872d84a9bbce3f390df06a0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:42:55.102129 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4925064b-042b-4a3f-9ccc-f95f7ef69a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:55.170667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1133/2277] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:42:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:42:55.181589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38088c6d-822b-4df0-9de8-ea75fcd8f8e9 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:55.183352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-38088c6d-822b-4df0-9de8-ea75fcd8f8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:55.257094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38088c6d-822b-4df0-9de8-ea75fcd8f8e9 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:55.263706 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e715-a65c-4313-ab8c-1d94556d1a24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:55.264359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e715-a65c-4313-ab8c-1d94556d1a24 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:55.264647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e715-a65c-4313-ab8c-1d94556d1a24 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:55.264929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967e715-a65c-4313-ab8c-1d94556d1a24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:55.272857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e715-a65c-4313-ab8c-1d94556d1a24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:55.275753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967e715-a65c-4313-ab8c-1d94556d1a24 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:55.284462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1145/2278] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:42:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:42:57.128295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925064b-042b-4a3f-9ccc-f95f7ef69a24 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:57.129780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4925064b-042b-4a3f-9ccc-f95f7ef69a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:57.188397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925064b-042b-4a3f-9ccc-f95f7ef69a24 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:57.192089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a754eb-7447-4c6f-b403-51685a174dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:57.192737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a754eb-7447-4c6f-b403-51685a174dad service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:57.193019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a754eb-7447-4c6f-b403-51685a174dad service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:57.193325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a754eb-7447-4c6f-b403-51685a174dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:57.195316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c7a754eb-7447-4c6f-b403-51685a174dad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:57.208950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a754eb-7447-4c6f-b403-51685a174dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:57.210405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a754eb-7447-4c6f-b403-51685a174dad service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:57.221428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1134/2279] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:42:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:42:59.866337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e715-a65c-4313-ab8c-1d94556d1a24 service nova] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:42:59.868366 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0967e715-a65c-4313-ab8c-1d94556d1a24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:59.880119 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967e715-a65c-4313-ab8c-1d94556d1a24 service nova] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:42:59.884753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd72067-0276-4615-880f-54dcdab9e65b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:42:59.885440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd72067-0276-4615-880f-54dcdab9e65b service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:42:59.885725 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd72067-0276-4615-880f-54dcdab9e65b service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:42:59.886002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd72067-0276-4615-880f-54dcdab9e65b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:42:59.887794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9dd72067-0276-4615-880f-54dcdab9e65b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:42:59.900935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd72067-0276-4615-880f-54dcdab9e65b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:42:59.902426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd72067-0276-4615-880f-54dcdab9e65b service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:42:59.913431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1146/2280] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:42:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:03.700461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a754eb-7447-4c6f-b403-51685a174dad service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:03.702152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c7a754eb-7447-4c6f-b403-51685a174dad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:03.794361 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a754eb-7447-4c6f-b403-51685a174dad service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:03.799152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:03.800038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:03.800322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:03.800605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] PATH_INFO: `/v3/users/d6afc66e1d4b473e9a8e6abf1737b64d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:03.801830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6afc66e1d4b473e9a8e6abf1737b64d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:03.803819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:03.823826 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd72067-0276-4615-880f-54dcdab9e65b service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:03.840293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd72067-0276-4615-880f-54dcdab9e65b service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:03.840293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:03.840293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:03.840293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:03.840715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] PATH_INFO: `/v3/users/c813e15872d84a9bbce3f390df06a0b7` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:03.840715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c813e15872d84a9bbce3f390df06a0b7)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:03.842418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:04.046379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6afc66e1d4b473e9a8e6abf1737b64d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.060705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6afc66e1d4b473e9a8e6abf1737b64d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.061899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6afc66e1d4b473e9a8e6abf1737b64d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.074874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c813e15872d84a9bbce3f390df06a0b7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.074874 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c813e15872d84a9bbce3f390df06a0b7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.077314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c813e15872d84a9bbce3f390df06a0b7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.091322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c813e15872d84a9bbce3f390df06a0b7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.099508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c813e15872d84a9bbce3f390df06a0b7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.136975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6afc66e1d4b473e9a8e6abf1737b64d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.145261 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e3327e46-1d4c-4a52-aee9-c64ec77f92a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6afc66e1d4b473e9a8e6abf1737b64d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.155147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1135/2281] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:03 2022] DELETE /identity/v3/users/d6afc66e1d4b473e9a8e6abf1737b64d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:04.185904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1147/2282] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:03 2022] DELETE /identity/v3/users/c813e15872d84a9bbce3f390df06a0b7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:04.190508 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c1d14-6771-4e89-a057-7af6e0b16629 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:04.190803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c1d14-6771-4e89-a057-7af6e0b16629 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:04.191086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c1d14-6771-4e89-a057-7af6e0b16629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:04.215750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-707c1d14-6771-4e89-a057-7af6e0b16629 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:04.217145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-707c1d14-6771-4e89-a057-7af6e0b16629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:04.292808 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1136/2283] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:04.308073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:04.309978 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:04.376837 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fc8d-96b8-447f-9343-48f369ca3562 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:04.380891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482039b-165d-4fc6-bd1b-682dd8671273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:04.386748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482039b-165d-4fc6-bd1b-682dd8671273 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:04.386748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482039b-165d-4fc6-bd1b-682dd8671273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:04.386748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482039b-165d-4fc6-bd1b-682dd8671273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:04.392452 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482039b-165d-4fc6-bd1b-682dd8671273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:04.393943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482039b-165d-4fc6-bd1b-682dd8671273 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:04.404782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1148/2284] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:04.415357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c1d14-6771-4e89-a057-7af6e0b16629 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:04.416960 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-707c1d14-6771-4e89-a057-7af6e0b16629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:04.429080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c1d14-6771-4e89-a057-7af6e0b16629 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:04.446797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:04.447694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:04.447987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:04.448448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] PATH_INFO: `/v3/projects/fcbad83733994c35979d60f1bbaf280c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:04.450401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbad83733994c35979d60f1bbaf280c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:04.452616 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:04.572561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbad83733994c35979d60f1bbaf280c', 'request_id': 'req-d55ac3bf-4740-4f99-8cf0-8e4462277b14'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.578640 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbad83733994c35979d60f1bbaf280c', 'request_id': 'req-d55ac3bf-4740-4f99-8cf0-8e4462277b14'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.671684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbad83733994c35979d60f1bbaf280c', 'request_id': 'req-d55ac3bf-4740-4f99-8cf0-8e4462277b14'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.684284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] The token cache is being invalidate because project fcbad83733994c35979d60f1bbaf280c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:04.684767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.685537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:04.687247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1137/2285] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:04 2022] DELETE /identity/v3/projects/fcbad83733994c35979d60f1bbaf280c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:04.691702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482039b-165d-4fc6-bd1b-682dd8671273 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:04.701695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482039b-165d-4fc6-bd1b-682dd8671273 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:04.760239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:04.761127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:04.761466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:04.763348 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] PATH_INFO: `/v3/users/121d1f97713b4503a8694cf92405b3d6` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:04.763348 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121d1f97713b4503a8694cf92405b3d6)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:04.764908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:04.906988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:04.908528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:04.922385 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ac3bf-4740-4f99-8cf0-8e4462277b14 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:04.928255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:04.929611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:04.929850 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:04.930414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] PATH_INFO: `/v3/projects/8fb25cc42cb64f07a42dc479e5a6c5e6` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:04.936671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb25cc42cb64f07a42dc479e5a6c5e6)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:04.939151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:05.014720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121d1f97713b4503a8694cf92405b3d6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.015974 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121d1f97713b4503a8694cf92405b3d6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.016552 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121d1f97713b4503a8694cf92405b3d6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.031303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121d1f97713b4503a8694cf92405b3d6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.042062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c037fcd7-1801-4483-9822-db0b891557c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121d1f97713b4503a8694cf92405b3d6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.064970 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb25cc42cb64f07a42dc479e5a6c5e6', 'request_id': 'req-4809e828-2b2a-40de-8498-e8d5bae76ffb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.073212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb25cc42cb64f07a42dc479e5a6c5e6', 'request_id': 'req-4809e828-2b2a-40de-8498-e8d5bae76ffb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.146877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1149/2286] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:04 2022] DELETE /identity/v3/users/121d1f97713b4503a8694cf92405b3d6 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:05.251906 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb25cc42cb64f07a42dc479e5a6c5e6', 'request_id': 'req-4809e828-2b2a-40de-8498-e8d5bae76ffb'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.268946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] The token cache is being invalidate because project 8fb25cc42cb64f07a42dc479e5a6c5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:05.269417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.270401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4809e828-2b2a-40de-8498-e8d5bae76ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.273736 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1138/2287] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:04 2022] DELETE /identity/v3/projects/8fb25cc42cb64f07a42dc479e5a6c5e6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:05.278793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219ff3d-b06a-4421-8753-bf447e02f2bf None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.279237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219ff3d-b06a-4421-8753-bf447e02f2bf None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.279618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219ff3d-b06a-4421-8753-bf447e02f2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.314531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-7219ff3d-b06a-4421-8753-bf447e02f2bf None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:05.315770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7219ff3d-b06a-4421-8753-bf447e02f2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:05.407321 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1150/2288] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:05.416901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40d62f-3958-4aba-9eda-19719980d2c7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.417192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40d62f-3958-4aba-9eda-19719980d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.417575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40d62f-3958-4aba-9eda-19719980d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.436557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ac40d62f-3958-4aba-9eda-19719980d2c7 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:05.437843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ac40d62f-3958-4aba-9eda-19719980d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:05.449070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1139/2289] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:05.454292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219ff3d-b06a-4421-8753-bf447e02f2bf None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:05.468024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219ff3d-b06a-4421-8753-bf447e02f2bf None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:05.470899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40d62f-3958-4aba-9eda-19719980d2c7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:05.473367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ac40d62f-3958-4aba-9eda-19719980d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:05.483699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb17f4-936e-416e-9ac7-495634a9ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:05.483821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb17f4-936e-416e-9ac7-495634a9ce46 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.485163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb17f4-936e-416e-9ac7-495634a9ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.485509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb17f4-936e-416e-9ac7-495634a9ce46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.486636 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb17f4-936e-416e-9ac7-495634a9ce46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:43:05.487031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb17f4-936e-416e-9ac7-495634a9ce46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:05.488713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb17f4-936e-416e-9ac7-495634a9ce46 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:05.490006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40d62f-3958-4aba-9eda-19719980d2c7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:05.497368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:05.498598 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.499088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.499565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] PATH_INFO: `/v3/projects/e52be49f7c694968b392e765935d174c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.502632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52be49f7c694968b392e765935d174c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:05.504472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:05.506293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1151/2290] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:43:05.511807 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb17f4-936e-416e-9ac7-495634a9ce46 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:05.527203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb17f4-936e-416e-9ac7-495634a9ce46 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:05.533741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b55f-b658-4999-bade-e421047fa4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:05.534643 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b55f-b658-4999-bade-e421047fa4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.535164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b55f-b658-4999-bade-e421047fa4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.535620 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b55f-b658-4999-bade-e421047fa4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.536541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7b55f-b658-4999-bade-e421047fa4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:05.538990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7b55f-b658-4999-bade-e421047fa4b3 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:05.714309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1152/2291] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:05 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:05.718781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b55f-b658-4999-bade-e421047fa4b3 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:05.724639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52be49f7c694968b392e765935d174c', 'request_id': 'req-3a34909b-412c-496e-b5fd-6ab915ec125e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.731038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52be49f7c694968b392e765935d174c', 'request_id': 'req-3a34909b-412c-496e-b5fd-6ab915ec125e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.784242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b55f-b658-4999-bade-e421047fa4b3 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:05.791894 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e3c15-d38c-41c2-9d56-142b039f2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:05.792642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e3c15-d38c-41c2-9d56-142b039f2b91 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.792926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e3c15-d38c-41c2-9d56-142b039f2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.793203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e3c15-d38c-41c2-9d56-142b039f2b91 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.793990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e3c15-d38c-41c2-9d56-142b039f2b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:05.795901 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e3c15-d38c-41c2-9d56-142b039f2b91 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:05.800278 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52be49f7c694968b392e765935d174c', 'request_id': 'req-3a34909b-412c-496e-b5fd-6ab915ec125e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.814141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] The token cache is being invalidate because project e52be49f7c694968b392e765935d174c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:05.814452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.815100 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3a34909b-412c-496e-b5fd-6ab915ec125e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:05.816655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1140/2292] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:05 2022] DELETE /identity/v3/projects/e52be49f7c694968b392e765935d174c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:05.822734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15a43e-5b2f-4f5d-8523-991f414450d5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.823026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15a43e-5b2f-4f5d-8523-991f414450d5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.823295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15a43e-5b2f-4f5d-8523-991f414450d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.846980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3c15a43e-5b2f-4f5d-8523-991f414450d5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:05.848279 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3c15a43e-5b2f-4f5d-8523-991f414450d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:05.857357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1141/2293] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:43:05.867454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d844680-73a7-4aa8-ae53-2a046bb64608 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.867454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d844680-73a7-4aa8-ae53-2a046bb64608 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.867454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d844680-73a7-4aa8-ae53-2a046bb64608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.897704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1153/2294] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:05 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:05.902908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e3c15-d38c-41c2-9d56-142b039f2b91 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:05.905143 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-9d844680-73a7-4aa8-ae53-2a046bb64608 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:05.907128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4a6e3c15-d38c-41c2-9d56-142b039f2b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:05.908853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9d844680-73a7-4aa8-ae53-2a046bb64608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:05.917976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1142/2295] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:43:05.927180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d844680-73a7-4aa8-ae53-2a046bb64608 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:05.929676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e3c15-d38c-41c2-9d56-142b039f2b91 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:05.936371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba1248-2e4a-401f-bfc6-6e7feccdd3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:05.937151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1248-2e4a-401f-bfc6-6e7feccdd3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.937696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d844680-73a7-4aa8-ae53-2a046bb64608 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:05.937799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1248-2e4a-401f-bfc6-6e7feccdd3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.937886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1248-2e4a-401f-bfc6-6e7feccdd3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.938629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba1248-2e4a-401f-bfc6-6e7feccdd3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:05.940218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba1248-2e4a-401f-bfc6-6e7feccdd3c9 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:05.942265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f733-7b6a-4fad-b9f1-e6afc9f11c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:05.943120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f733-7b6a-4fad-b9f1-e6afc9f11c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.943563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f733-7b6a-4fad-b9f1-e6afc9f11c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.943997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f733-7b6a-4fad-b9f1-e6afc9f11c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.945506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333f733-7b6a-4fad-b9f1-e6afc9f11c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:43:05.946013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333f733-7b6a-4fad-b9f1-e6afc9f11c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:05.947774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333f733-7b6a-4fad-b9f1-e6afc9f11c07 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:05.951862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1154/2296] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:05.959280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba1248-2e4a-401f-bfc6-6e7feccdd3c9 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:05.961497 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1143/2297] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:43:05.964484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f733-7b6a-4fad-b9f1-e6afc9f11c07 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:05.969426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba1248-2e4a-401f-bfc6-6e7feccdd3c9 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:05.974281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f733-7b6a-4fad-b9f1-e6afc9f11c07 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:05.974499 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a791b-3f44-4f2f-ba3e-4eb81113a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:05.975255 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a791b-3f44-4f2f-ba3e-4eb81113a578 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.980695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a791b-3f44-4f2f-ba3e-4eb81113a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.980695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a791b-3f44-4f2f-ba3e-4eb81113a578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.980695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a791b-3f44-4f2f-ba3e-4eb81113a578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:05.980695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a791b-3f44-4f2f-ba3e-4eb81113a578 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:05.981086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d66277-c899-4d88-88d5-90e44c9297ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:05.981086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d66277-c899-4d88-88d5-90e44c9297ba admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:05.981086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d66277-c899-4d88-88d5-90e44c9297ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:05.981086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d66277-c899-4d88-88d5-90e44c9297ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:05.981621 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d66277-c899-4d88-88d5-90e44c9297ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:05.983024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d66277-c899-4d88-88d5-90e44c9297ba admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:05.991003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1155/2298] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:43:05.995200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a791b-3f44-4f2f-ba3e-4eb81113a578 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.005115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a791b-3f44-4f2f-ba3e-4eb81113a578 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.010906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467073a-b1fa-4f65-9237-698885ff5280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.011804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467073a-b1fa-4f65-9237-698885ff5280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.012088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467073a-b1fa-4f65-9237-698885ff5280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.012365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467073a-b1fa-4f65-9237-698885ff5280 admin admin] PATH_INFO: `/v3/projects/48f435483e484058a98aad1b6b0c2131/users/c003383b2dab4788adfa70b252e709f3/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.028635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467073a-b1fa-4f65-9237-698885ff5280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f435483e484058a98aad1b6b0c2131, user_id=c003383b2dab4788adfa70b252e709f3, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.031672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467073a-b1fa-4f65-9237-698885ff5280 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:06.142165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1144/2299] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:05 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:43:06.146959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d66277-c899-4d88-88d5-90e44c9297ba admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.176855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1156/2300] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:05 2022] PUT /identity/v3/projects/48f435483e484058a98aad1b6b0c2131/users/c003383b2dab4788adfa70b252e709f3/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:06.192289 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e7709-62e9-4a19-a7d3-b33bed9a8a41 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.192990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e7709-62e9-4a19-a7d3-b33bed9a8a41 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.193302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e7709-62e9-4a19-a7d3-b33bed9a8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.218600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d66277-c899-4d88-88d5-90e44c9297ba admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.223282 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5f6e7709-62e9-4a19-a7d3-b33bed9a8a41 None None] MFA Rules not processed for user `c003383b2dab4788adfa70b252e709f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:06.225312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5f6e7709-62e9-4a19-a7d3-b33bed9a8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:06.296914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd173c0-a26b-487a-ac64-4c68ccf88941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.297632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd173c0-a26b-487a-ac64-4c68ccf88941 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.297962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd173c0-a26b-487a-ac64-4c68ccf88941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.298284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd173c0-a26b-487a-ac64-4c68ccf88941 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.299137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd173c0-a26b-487a-ac64-4c68ccf88941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.301132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd173c0-a26b-487a-ac64-4c68ccf88941 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:06.310988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1157/2301] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:43:06.315556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e7709-62e9-4a19-a7d3-b33bed9a8a41 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.326377 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e7709-62e9-4a19-a7d3-b33bed9a8a41 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.331076 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed94ec-dba9-4660-ab33-fe59f4ebc8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.332988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed94ec-dba9-4660-ab33-fe59f4ebc8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.332988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed94ec-dba9-4660-ab33-fe59f4ebc8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.332988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed94ec-dba9-4660-ab33-fe59f4ebc8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.332988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed94ec-dba9-4660-ab33-fe59f4ebc8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.335006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed94ec-dba9-4660-ab33-fe59f4ebc8e6 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:06.407132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1145/2302] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:06 2022] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:06.408534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd173c0-a26b-487a-ac64-4c68ccf88941 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.418310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd173c0-a26b-487a-ac64-4c68ccf88941 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.422992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a844-34ee-4723-b40b-88295812e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.423654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a844-34ee-4723-b40b-88295812e4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.423958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a844-34ee-4723-b40b-88295812e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.424346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a844-34ee-4723-b40b-88295812e4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.424940 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595a844-34ee-4723-b40b-88295812e4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.426572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595a844-34ee-4723-b40b-88295812e4a1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:06.436696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1146/2303] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:43:06.444115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a844-34ee-4723-b40b-88295812e4a1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.454760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a844-34ee-4723-b40b-88295812e4a1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.459524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753324e-cbaf-4545-823d-51faf251bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.464759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753324e-cbaf-4545-823d-51faf251bd4e admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.464759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753324e-cbaf-4545-823d-51faf251bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.464759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753324e-cbaf-4545-823d-51faf251bd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.464759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753324e-cbaf-4545-823d-51faf251bd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.464759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753324e-cbaf-4545-823d-51faf251bd4e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:06.472387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1158/2304] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:06 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:43:06.474675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1147/2305] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:43:06.477796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed94ec-dba9-4660-ab33-fe59f4ebc8e6 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.482372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753324e-cbaf-4545-823d-51faf251bd4e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.492370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753324e-cbaf-4545-823d-51faf251bd4e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.540051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed94ec-dba9-4660-ab33-fe59f4ebc8e6 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.545217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cda656-5461-4513-8fcc-27b48a0cf754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.545958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cda656-5461-4513-8fcc-27b48a0cf754 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.546245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cda656-5461-4513-8fcc-27b48a0cf754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.546525 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cda656-5461-4513-8fcc-27b48a0cf754 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.547221 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cda656-5461-4513-8fcc-27b48a0cf754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.549309 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cda656-5461-4513-8fcc-27b48a0cf754 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:06.549917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486140e-c104-463d-911f-4e4a3f2b8887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.550808 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486140e-c104-463d-911f-4e4a3f2b8887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.555539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486140e-c104-463d-911f-4e4a3f2b8887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.555539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486140e-c104-463d-911f-4e4a3f2b8887 admin admin] PATH_INFO: `/v3/projects/3d9b727e705940c5bbdad32f9cb69087/users/565a25c59df84a1fa6f6420093e89fb4/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.566609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486140e-c104-463d-911f-4e4a3f2b8887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9b727e705940c5bbdad32f9cb69087, user_id=565a25c59df84a1fa6f6420093e89fb4, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.569438 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486140e-c104-463d-911f-4e4a3f2b8887 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:06.685266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1159/2306] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:06 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:43:06.689257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cda656-5461-4513-8fcc-27b48a0cf754 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.700110 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cda656-5461-4513-8fcc-27b48a0cf754 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.701201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1148/2307] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:06 2022] PUT /identity/v3/projects/3d9b727e705940c5bbdad32f9cb69087/users/565a25c59df84a1fa6f6420093e89fb4/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:06.706472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb70e-07ae-4488-a858-e1fa6537781e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.706767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb70e-07ae-4488-a858-e1fa6537781e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.707078 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bb70e-07ae-4488-a858-e1fa6537781e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.727522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-936bb70e-07ae-4488-a858-e1fa6537781e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:06.728882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-936bb70e-07ae-4488-a858-e1fa6537781e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:06.772194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209084d-4963-4f40-bdfe-e5a43c80c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.773340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209084d-4963-4f40-bdfe-e5a43c80c8fb admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.773651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209084d-4963-4f40-bdfe-e5a43c80c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.773940 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209084d-4963-4f40-bdfe-e5a43c80c8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.774862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209084d-4963-4f40-bdfe-e5a43c80c8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.776633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209084d-4963-4f40-bdfe-e5a43c80c8fb admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:06.789470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1160/2308] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:43:06.793507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209084d-4963-4f40-bdfe-e5a43c80c8fb admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.796289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1149/2309] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:43:06.803450 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209084d-4963-4f40-bdfe-e5a43c80c8fb admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.810592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5898f5c-86e5-41f9-a10a-73ed27892c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.811368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5898f5c-86e5-41f9-a10a-73ed27892c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.811656 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5898f5c-86e5-41f9-a10a-73ed27892c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.811936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5898f5c-86e5-41f9-a10a-73ed27892c2d admin admin] PATH_INFO: `/v3/projects/9666c1081e8640caae7c29946833bf40/users/04bb2fd2607743a8a7453f2972a47523/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.818415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bb70e-07ae-4488-a858-e1fa6537781e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.821064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-936bb70e-07ae-4488-a858-e1fa6537781e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:06.828262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5898f5c-86e5-41f9-a10a-73ed27892c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9666c1081e8640caae7c29946833bf40, user_id=04bb2fd2607743a8a7453f2972a47523, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.830972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5898f5c-86e5-41f9-a10a-73ed27892c2d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:06.885988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bb70e-07ae-4488-a858-e1fa6537781e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.890044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc915c49-8a21-45c4-89d1-679a63a2f831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.890701 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915c49-8a21-45c4-89d1-679a63a2f831 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.890983 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915c49-8a21-45c4-89d1-679a63a2f831 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.891430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915c49-8a21-45c4-89d1-679a63a2f831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.901504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc915c49-8a21-45c4-89d1-679a63a2f831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.902924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc915c49-8a21-45c4-89d1-679a63a2f831 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:06.907540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1161/2310] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:06 2022] PUT /identity/v3/projects/9666c1081e8640caae7c29946833bf40/users/04bb2fd2607743a8a7453f2972a47523/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:06.913241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5898f5c-86e5-41f9-a10a-73ed27892c2d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:06.913415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1150/2311] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:43:06.990002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5898f5c-86e5-41f9-a10a-73ed27892c2d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:06.994832 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da043546-7fcc-4c52-8f06-c83bbc3e20ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:06.995659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043546-7fcc-4c52-8f06-c83bbc3e20ad admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:06.995947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043546-7fcc-4c52-8f06-c83bbc3e20ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:06.996231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043546-7fcc-4c52-8f06-c83bbc3e20ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:06.996966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da043546-7fcc-4c52-8f06-c83bbc3e20ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:06.998686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da043546-7fcc-4c52-8f06-c83bbc3e20ad admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:07.009120 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1162/2312] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:43:07.013618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc915c49-8a21-45c4-89d1-679a63a2f831 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:07.024740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc915c49-8a21-45c4-89d1-679a63a2f831 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:07.029808 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4192e-1e2b-48c3-9e33-7908aa01b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:07.030786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4192e-1e2b-48c3-9e33-7908aa01b1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:07.031069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4192e-1e2b-48c3-9e33-7908aa01b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:07.031341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4192e-1e2b-48c3-9e33-7908aa01b1a3 admin admin] PATH_INFO: `/v3/projects/9666c1081e8640caae7c29946833bf40/users/04bb2fd2607743a8a7453f2972a47523/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:07.033338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4192e-1e2b-48c3-9e33-7908aa01b1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9666c1081e8640caae7c29946833bf40, user_id=04bb2fd2607743a8a7453f2972a47523, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:07.036240 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4192e-1e2b-48c3-9e33-7908aa01b1a3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:07.048805 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1151/2313] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:07 2022] PUT /identity/v3/projects/9666c1081e8640caae7c29946833bf40/users/04bb2fd2607743a8a7453f2972a47523/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:07.059235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3e5a5-5654-4a32-ad1f-6f742994496b None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:07.059786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3e5a5-5654-4a32-ad1f-6f742994496b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:07.060004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3e5a5-5654-4a32-ad1f-6f742994496b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:07.094140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-89c3e5a5-5654-4a32-ad1f-6f742994496b None None] MFA Rules not processed for user `04bb2fd2607743a8a7453f2972a47523`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:07.095446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-89c3e5a5-5654-4a32-ad1f-6f742994496b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:07.170477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1163/2314] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:07.186075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4192e-1e2b-48c3-9e33-7908aa01b1a3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:07.187677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-79a4192e-1e2b-48c3-9e33-7908aa01b1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:07.256224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4192e-1e2b-48c3-9e33-7908aa01b1a3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:07.262101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7779-7b2e-4ff9-9d22-8f7ea07082b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:07.262773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7779-7b2e-4ff9-9d22-8f7ea07082b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:07.263068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7779-7b2e-4ff9-9d22-8f7ea07082b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:07.263351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7779-7b2e-4ff9-9d22-8f7ea07082b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:07.274415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a7779-7b2e-4ff9-9d22-8f7ea07082b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:07.275875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a7779-7b2e-4ff9-9d22-8f7ea07082b9 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:07.286177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1152/2315] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:09.983957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10d783-c8e8-46c8-a835-11ca6bdc9951 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:09.983957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10d783-c8e8-46c8-a835-11ca6bdc9951 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:09.983957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10d783-c8e8-46c8-a835-11ca6bdc9951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:10.003545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-cc10d783-c8e8-46c8-a835-11ca6bdc9951 None None] MFA Rules not processed for user `e3fa08cd466c419e80198a5b44b719f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:10.004897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-cc10d783-c8e8-46c8-a835-11ca6bdc9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:10.079896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1164/2316] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:10.614322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7779-7b2e-4ff9-9d22-8f7ea07082b9 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:10.721453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7779-7b2e-4ff9-9d22-8f7ea07082b9 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:10.736754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:10.737844 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:10.738253 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:10.738790 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] PATH_INFO: `/v3/users/c003383b2dab4788adfa70b252e709f3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:10.741397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c003383b2dab4788adfa70b252e709f3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:10.744068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:11.034082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10d783-c8e8-46c8-a835-11ca6bdc9951 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:11.037031 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-cc10d783-c8e8-46c8-a835-11ca6bdc9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:11.040151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c003383b2dab4788adfa70b252e709f3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:11.061775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c003383b2dab4788adfa70b252e709f3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:11.062882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c003383b2dab4788adfa70b252e709f3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:11.133373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10d783-c8e8-46c8-a835-11ca6bdc9951 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:11.139090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53dbb0-cb16-4861-9399-ff8ca1101e0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:11.139776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53dbb0-cb16-4861-9399-ff8ca1101e0d service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:11.140067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53dbb0-cb16-4861-9399-ff8ca1101e0d service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:11.140348 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53dbb0-cb16-4861-9399-ff8ca1101e0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:11.142292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2f53dbb0-cb16-4861-9399-ff8ca1101e0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:11.156928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53dbb0-cb16-4861-9399-ff8ca1101e0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:11.159283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53dbb0-cb16-4861-9399-ff8ca1101e0d service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:11.171310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1165/2317] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:43:11.178572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c003383b2dab4788adfa70b252e709f3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:11.189589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53dbb0-cb16-4861-9399-ff8ca1101e0d service placement] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:11.192398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-674978f7-9924-4c3c-892a-3939cc81f33b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c003383b2dab4788adfa70b252e709f3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:11.205609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53dbb0-cb16-4861-9399-ff8ca1101e0d service placement] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:11.207164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1153/2318] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:10 2022] DELETE /identity/v3/users/c003383b2dab4788adfa70b252e709f3 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:11.212485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb5915-ae0f-4f0d-ad87-cc06b1ab17a0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:11.213227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb5915-ae0f-4f0d-ad87-cc06b1ab17a0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:11.213227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb5915-ae0f-4f0d-ad87-cc06b1ab17a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:11.239554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-19bb5915-ae0f-4f0d-ad87-cc06b1ab17a0 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:11.240908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-19bb5915-ae0f-4f0d-ad87-cc06b1ab17a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:11.336666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e3302-595b-407e-81b4-d4a2dd7da748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:11.337411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e3302-595b-407e-81b4-d4a2dd7da748 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:11.337699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e3302-595b-407e-81b4-d4a2dd7da748 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:11.337979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e3302-595b-407e-81b4-d4a2dd7da748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:11.347656 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a10e3302-595b-407e-81b4-d4a2dd7da748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:11.354883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1154/2319] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:43:11.365333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb5915-ae0f-4f0d-ad87-cc06b1ab17a0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:11.367377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-19bb5915-ae0f-4f0d-ad87-cc06b1ab17a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:11.480401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e3302-595b-407e-81b4-d4a2dd7da748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:11.482096 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e3302-595b-407e-81b4-d4a2dd7da748 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:11.499867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb5915-ae0f-4f0d-ad87-cc06b1ab17a0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:11.503841 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cfdfd-0e70-4f73-8a91-2e422ddf93a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:11.505058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cfdfd-0e70-4f73-8a91-2e422ddf93a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:11.505795 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cfdfd-0e70-4f73-8a91-2e422ddf93a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:11.506244 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cfdfd-0e70-4f73-8a91-2e422ddf93a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:11.508880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1166/2320] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:43:11.520139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cfdfd-0e70-4f73-8a91-2e422ddf93a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:11.521714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cfdfd-0e70-4f73-8a91-2e422ddf93a9 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:11.546240 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1155/2321] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:12.055220 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e3302-595b-407e-81b4-d4a2dd7da748 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:12.057793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a10e3302-595b-407e-81b4-d4a2dd7da748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:12.097646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e3302-595b-407e-81b4-d4a2dd7da748 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:12.107805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:12.108865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:12.109153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:12.109466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] PATH_INFO: `/v3/projects/48f435483e484058a98aad1b6b0c2131` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:12.110663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f435483e484058a98aad1b6b0c2131)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:12.112618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:12.275269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f435483e484058a98aad1b6b0c2131', 'request_id': 'req-a698550c-1502-4850-ab09-9c0c54af7259'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:12.284327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f435483e484058a98aad1b6b0c2131', 'request_id': 'req-a698550c-1502-4850-ab09-9c0c54af7259'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:12.363472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f435483e484058a98aad1b6b0c2131', 'request_id': 'req-a698550c-1502-4850-ab09-9c0c54af7259'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:12.388820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] The token cache is being invalidate because project 48f435483e484058a98aad1b6b0c2131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:12.389463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:12.390373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:12.396557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cfdfd-0e70-4f73-8a91-2e422ddf93a9 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:12.408124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cfdfd-0e70-4f73-8a91-2e422ddf93a9 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:12.408437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1167/2322] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:12 2022] DELETE /identity/v3/projects/48f435483e484058a98aad1b6b0c2131 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:12.474501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:12.475569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:12.476284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:12.476284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] PATH_INFO: `/v3/users/04bb2fd2607743a8a7453f2972a47523` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:12.477956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=04bb2fd2607743a8a7453f2972a47523)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:12.479920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:12.701789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04bb2fd2607743a8a7453f2972a47523'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:12.717892 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04bb2fd2607743a8a7453f2972a47523'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:12.718510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04bb2fd2607743a8a7453f2972a47523'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:12.812014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04bb2fd2607743a8a7453f2972a47523'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:12.823439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d0cdc10c-be75-4e9d-a232-82fc504e9a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04bb2fd2607743a8a7453f2972a47523'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:12.833342 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1156/2323] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:12 2022] DELETE /identity/v3/users/04bb2fd2607743a8a7453f2972a47523 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:13.330397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:13.332674 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:13.364164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698550c-1502-4850-ab09-9c0c54af7259 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:13.527758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:13.528763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:13.529224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:13.529697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] PATH_INFO: `/v3/projects/9666c1081e8640caae7c29946833bf40` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:13.531140 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9666c1081e8640caae7c29946833bf40)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:13.533212 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:13.681443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6965-f8c9-491f-ba6f-19ad53d6c727 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:13.681921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6965-f8c9-491f-ba6f-19ad53d6c727 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:13.682016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f6965-f8c9-491f-ba6f-19ad53d6c727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:13.721730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-654f6965-f8c9-491f-ba6f-19ad53d6c727 None None] MFA Rules not processed for user `565a25c59df84a1fa6f6420093e89fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:13.722977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-654f6965-f8c9-491f-ba6f-19ad53d6c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:13.730492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9666c1081e8640caae7c29946833bf40', 'request_id': 'req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:13.737992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9666c1081e8640caae7c29946833bf40', 'request_id': 'req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:13.802984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1157/2324] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:13.806314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9666c1081e8640caae7c29946833bf40', 'request_id': 'req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:13.814516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f6965-f8c9-491f-ba6f-19ad53d6c727 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:13.819039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] The token cache is being invalidate because project 9666c1081e8640caae7c29946833bf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:13.819397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:13.820982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-61ebeb92-70fb-4cd9-8b0b-63d3fab5750a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:13.822742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1168/2325] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:13 2022] DELETE /identity/v3/projects/9666c1081e8640caae7c29946833bf40 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:13.824293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-654f6965-f8c9-491f-ba6f-19ad53d6c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:13.827578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a160e-8cc9-4753-9a12-87d5d8ce578e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:13.828064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a160e-8cc9-4753-9a12-87d5d8ce578e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:13.828541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a160e-8cc9-4753-9a12-87d5d8ce578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:13.849932 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-7a9a160e-8cc9-4753-9a12-87d5d8ce578e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:13.851757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7a9a160e-8cc9-4753-9a12-87d5d8ce578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:13.894913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f6965-f8c9-491f-ba6f-19ad53d6c727 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:13.901289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3b5fa-7f19-49e4-92c5-313151c4798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:13.902060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3b5fa-7f19-49e4-92c5-313151c4798c admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:13.902520 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3b5fa-7f19-49e4-92c5-313151c4798c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:13.902948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3b5fa-7f19-49e4-92c5-313151c4798c admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:13.903846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3b5fa-7f19-49e4-92c5-313151c4798c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:13.906220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3b5fa-7f19-49e4-92c5-313151c4798c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:13.965932 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1169/2326] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:13.973529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8fc6-4da7-43dd-aca5-b2ec21c020c4 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:13.973819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8fc6-4da7-43dd-aca5-b2ec21c020c4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:13.974102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8fc6-4da7-43dd-aca5-b2ec21c020c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:13.996672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-3d6b8fc6-4da7-43dd-aca5-b2ec21c020c4 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:13.997931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3d6b8fc6-4da7-43dd-aca5-b2ec21c020c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:14.006751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1170/2327] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:43:14.011390 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8fc6-4da7-43dd-aca5-b2ec21c020c4 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.020615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8fc6-4da7-43dd-aca5-b2ec21c020c4 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.028128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad4998-9628-4e2c-8e03-fae9e21c901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.028806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad4998-9628-4e2c-8e03-fae9e21c901e admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.029094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad4998-9628-4e2c-8e03-fae9e21c901e admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.029410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad4998-9628-4e2c-8e03-fae9e21c901e admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.030196 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad4998-9628-4e2c-8e03-fae9e21c901e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:43:14.030591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad4998-9628-4e2c-8e03-fae9e21c901e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.032786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad4998-9628-4e2c-8e03-fae9e21c901e admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.042241 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1158/2328] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:13 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:14.047557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3b5fa-7f19-49e4-92c5-313151c4798c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.050543 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4ff3b5fa-7f19-49e4-92c5-313151c4798c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:14.056455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1171/2329] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:43:14.066343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad4998-9628-4e2c-8e03-fae9e21c901e admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.079508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad4998-9628-4e2c-8e03-fae9e21c901e admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.139706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3b5fa-7f19-49e4-92c5-313151c4798c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.144653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983594eb-e484-4ea6-bbe9-eb44aed72c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.152438 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983594eb-e484-4ea6-bbe9-eb44aed72c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.152438 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983594eb-e484-4ea6-bbe9-eb44aed72c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.152639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa4806-a474-4873-a0df-47de47b84a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.152737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983594eb-e484-4ea6-bbe9-eb44aed72c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.152829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa4806-a474-4873-a0df-47de47b84a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.152916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983594eb-e484-4ea6-bbe9-eb44aed72c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.152993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa4806-a474-4873-a0df-47de47b84a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.152993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa4806-a474-4873-a0df-47de47b84a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.152993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa4806-a474-4873-a0df-47de47b84a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.153193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983594eb-e484-4ea6-bbe9-eb44aed72c67 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.153344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa4806-a474-4873-a0df-47de47b84a16 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.264994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1159/2330] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:14 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 20:43:14.265223 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1172/2331] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:14 2022] POST /identity/v3/projects => generated 391 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:14.266588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983594eb-e484-4ea6-bbe9-eb44aed72c67 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.267247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa4806-a474-4873-a0df-47de47b84a16 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.280465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983594eb-e484-4ea6-bbe9-eb44aed72c67 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.345410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa4806-a474-4873-a0df-47de47b84a16 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.350166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca3a7-c040-45eb-b7e1-4a293e893df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.351314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fca1da-f80b-40f4-b0aa-2a73e2ce65ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.351468 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca3a7-c040-45eb-b7e1-4a293e893df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.351933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca3a7-c040-45eb-b7e1-4a293e893df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.352219 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fca1da-f80b-40f4-b0aa-2a73e2ce65ad admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.352341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca3a7-c040-45eb-b7e1-4a293e893df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.352626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fca1da-f80b-40f4-b0aa-2a73e2ce65ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.353017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fca1da-f80b-40f4-b0aa-2a73e2ce65ad admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.353626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ca3a7-c040-45eb-b7e1-4a293e893df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.353889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fca1da-f80b-40f4-b0aa-2a73e2ce65ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.355258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ca3a7-c040-45eb-b7e1-4a293e893df0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.355948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fca1da-f80b-40f4-b0aa-2a73e2ce65ad admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.367153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1160/2332] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:43:14.376350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca3a7-c040-45eb-b7e1-4a293e893df0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.388729 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca3a7-c040-45eb-b7e1-4a293e893df0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.396262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61fa9e-53f3-4a1f-a84d-7a7595223843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.396262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61fa9e-53f3-4a1f-a84d-7a7595223843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.396262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61fa9e-53f3-4a1f-a84d-7a7595223843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.396262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61fa9e-53f3-4a1f-a84d-7a7595223843 admin admin] PATH_INFO: `/v3/projects/0ff9aa29235548bf84f2f9fa243f52c7/users/827d3c3570344412913fbdc764a7ce8e/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.412478 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61fa9e-53f3-4a1f-a84d-7a7595223843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff9aa29235548bf84f2f9fa243f52c7, user_id=827d3c3570344412913fbdc764a7ce8e, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.416600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61fa9e-53f3-4a1f-a84d-7a7595223843 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.463106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1173/2333] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:14 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:14.467243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fca1da-f80b-40f4-b0aa-2a73e2ce65ad admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.488045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fca1da-f80b-40f4-b0aa-2a73e2ce65ad admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.495702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3281bc-79e8-491b-8499-b6722ef3d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.497769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3281bc-79e8-491b-8499-b6722ef3d4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.498075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3281bc-79e8-491b-8499-b6722ef3d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.498404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3281bc-79e8-491b-8499-b6722ef3d4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.499301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3281bc-79e8-491b-8499-b6722ef3d4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.502144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3281bc-79e8-491b-8499-b6722ef3d4c6 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.515567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1174/2334] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:14.522786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3281bc-79e8-491b-8499-b6722ef3d4c6 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.524002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1161/2335] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:14 2022] PUT /identity/v3/projects/0ff9aa29235548bf84f2f9fa243f52c7/users/827d3c3570344412913fbdc764a7ce8e/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:14.528044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61fa9e-53f3-4a1f-a84d-7a7595223843 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.535272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3281bc-79e8-491b-8499-b6722ef3d4c6 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.638238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd66ae-1354-451f-84eb-729c0426906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.639067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd66ae-1354-451f-84eb-729c0426906b admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.639454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd66ae-1354-451f-84eb-729c0426906b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.639843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd66ae-1354-451f-84eb-729c0426906b admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.640709 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd66ae-1354-451f-84eb-729c0426906b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.649376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd66ae-1354-451f-84eb-729c0426906b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.656759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61fa9e-53f3-4a1f-a84d-7a7595223843 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.656960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1175/2336] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:14.661088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd66ae-1354-451f-84eb-729c0426906b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.667308 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce2282-d6cf-454b-8e4e-e216cefab6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.668265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce2282-d6cf-454b-8e4e-e216cefab6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.668755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce2282-d6cf-454b-8e4e-e216cefab6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.669194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce2282-d6cf-454b-8e4e-e216cefab6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.670236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce2282-d6cf-454b-8e4e-e216cefab6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.672960 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce2282-d6cf-454b-8e4e-e216cefab6f5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.673910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd66ae-1354-451f-84eb-729c0426906b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.679756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700109a-5778-43c5-b279-433186866df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.680680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700109a-5778-43c5-b279-433186866df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.680968 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700109a-5778-43c5-b279-433186866df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.688264 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1162/2337] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:14.691999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce2282-d6cf-454b-8e4e-e216cefab6f5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.697748 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700109a-5778-43c5-b279-433186866df4 admin admin] PATH_INFO: `/v3/projects/18467281ad144f54b84c0844f538431a/users/b67d41236c374313aacf9621f20c0a5b/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.702421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce2282-d6cf-454b-8e4e-e216cefab6f5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:14.708052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b2da7-4be7-4c87-9502-fd15799b466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:14.709033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b2da7-4be7-4c87-9502-fd15799b466a admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.709349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b2da7-4be7-4c87-9502-fd15799b466a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.709764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b2da7-4be7-4c87-9502-fd15799b466a admin admin] PATH_INFO: `/v3/projects/0ff9aa29235548bf84f2f9fa243f52c7/users/827d3c3570344412913fbdc764a7ce8e/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.712006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b2da7-4be7-4c87-9502-fd15799b466a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff9aa29235548bf84f2f9fa243f52c7, user_id=827d3c3570344412913fbdc764a7ce8e, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.714898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b2da7-4be7-4c87-9502-fd15799b466a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.728786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700109a-5778-43c5-b279-433186866df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18467281ad144f54b84c0844f538431a, user_id=b67d41236c374313aacf9621f20c0a5b, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:14.734176 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700109a-5778-43c5-b279-433186866df4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:14.739738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1163/2338] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:14 2022] PUT /identity/v3/projects/0ff9aa29235548bf84f2f9fa243f52c7/users/827d3c3570344412913fbdc764a7ce8e/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:14.846568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1176/2339] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:14 2022] PUT /identity/v3/projects/18467281ad144f54b84c0844f538431a/users/b67d41236c374313aacf9621f20c0a5b/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:14.858073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b0386-4f99-462e-a10c-0e5c12392535 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:14.858872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b0386-4f99-462e-a10c-0e5c12392535 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:14.859406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b0386-4f99-462e-a10c-0e5c12392535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:14.896534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-382b0386-4f99-462e-a10c-0e5c12392535 None None] MFA Rules not processed for user `b67d41236c374313aacf9621f20c0a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:14.908855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-382b0386-4f99-462e-a10c-0e5c12392535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:14.975340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700109a-5778-43c5-b279-433186866df4 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:14.978820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6700109a-5778-43c5-b279-433186866df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:15.045052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1164/2340] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:15.048829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b0386-4f99-462e-a10c-0e5c12392535 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:15.054138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700109a-5778-43c5-b279-433186866df4 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:15.058045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca7486-2035-45c0-b372-8b58d36069e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:15.058776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca7486-2035-45c0-b372-8b58d36069e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:15.059135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca7486-2035-45c0-b372-8b58d36069e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:15.059487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca7486-2035-45c0-b372-8b58d36069e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:15.061489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-42ca7486-2035-45c0-b372-8b58d36069e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:15.071651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca7486-2035-45c0-b372-8b58d36069e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:15.073300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca7486-2035-45c0-b372-8b58d36069e5 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:15.099008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1177/2341] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:43:15.160603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b0386-4f99-462e-a10c-0e5c12392535 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:15.168296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32da490-1029-49b2-990d-bba8a017513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:15.169837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32da490-1029-49b2-990d-bba8a017513b admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:15.173313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32da490-1029-49b2-990d-bba8a017513b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:15.173862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32da490-1029-49b2-990d-bba8a017513b admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:15.175421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32da490-1029-49b2-990d-bba8a017513b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:15.177842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32da490-1029-49b2-990d-bba8a017513b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:15.287709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1165/2342] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:15 2022] POST /identity/v3/projects => generated 393 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:15.292805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca7486-2035-45c0-b372-8b58d36069e5 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:15.313312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca7486-2035-45c0-b372-8b58d36069e5 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:15.396926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d4762-ff88-44ab-b689-4be6dfd4b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:15.397760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d4762-ff88-44ab-b689-4be6dfd4b10d admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:15.398781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d4762-ff88-44ab-b689-4be6dfd4b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:15.399069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d4762-ff88-44ab-b689-4be6dfd4b10d admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:15.399770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d4762-ff88-44ab-b689-4be6dfd4b10d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:15.402156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d4762-ff88-44ab-b689-4be6dfd4b10d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:15.526730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1178/2343] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:15 2022] POST /identity/v3/users => generated 303 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:15.530820 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32da490-1029-49b2-990d-bba8a017513b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:15.543430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32da490-1029-49b2-990d-bba8a017513b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:15.550510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada8c95-f6ad-4ef4-ab6b-8021f3345c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:15.551418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8c95-f6ad-4ef4-ab6b-8021f3345c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:15.551827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8c95-f6ad-4ef4-ab6b-8021f3345c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:15.552111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8c95-f6ad-4ef4-ab6b-8021f3345c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:15.552863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada8c95-f6ad-4ef4-ab6b-8021f3345c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:15.555237 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada8c95-f6ad-4ef4-ab6b-8021f3345c08 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:15.566638 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1166/2344] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:15.573682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d4762-ff88-44ab-b689-4be6dfd4b10d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:15.584527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d4762-ff88-44ab-b689-4be6dfd4b10d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:15.593577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562bc3-f330-4081-aae6-ca5093551dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:15.594415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562bc3-f330-4081-aae6-ca5093551dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:15.594708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562bc3-f330-4081-aae6-ca5093551dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:15.594992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53562bc3-f330-4081-aae6-ca5093551dd8 admin admin] PATH_INFO: `/v3/projects/b0cfaf5039394184aca25aa7e3b283b0/users/895038efad2c4fac825b82b0f7e682b3/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:15.629456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53562bc3-f330-4081-aae6-ca5093551dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cfaf5039394184aca25aa7e3b283b0, user_id=895038efad2c4fac825b82b0f7e682b3, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:15.633497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53562bc3-f330-4081-aae6-ca5093551dd8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:15.751221 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1179/2345] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:15 2022] PUT /identity/v3/projects/b0cfaf5039394184aca25aa7e3b283b0/users/895038efad2c4fac825b82b0f7e682b3/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:15.756636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada8c95-f6ad-4ef4-ab6b-8021f3345c08 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:15.776371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada8c95-f6ad-4ef4-ab6b-8021f3345c08 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:15.885570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b773a-0281-4f0b-a035-a34f905a2bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:15.886551 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b773a-0281-4f0b-a035-a34f905a2bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:15.887144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b773a-0281-4f0b-a035-a34f905a2bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:15.887874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b773a-0281-4f0b-a035-a34f905a2bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:15.888945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b773a-0281-4f0b-a035-a34f905a2bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:15.890792 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b773a-0281-4f0b-a035-a34f905a2bd3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:15.902950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1167/2346] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:15.907198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562bc3-f330-4081-aae6-ca5093551dd8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:15.920620 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53562bc3-f330-4081-aae6-ca5093551dd8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:15.925229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee20fc-a9af-4ffd-867f-0f49e4873d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:15.926404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee20fc-a9af-4ffd-867f-0f49e4873d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:15.926787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee20fc-a9af-4ffd-867f-0f49e4873d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:15.927197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee20fc-a9af-4ffd-867f-0f49e4873d51 admin admin] PATH_INFO: `/v3/projects/b0cfaf5039394184aca25aa7e3b283b0/users/895038efad2c4fac825b82b0f7e682b3/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:15.929906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee20fc-a9af-4ffd-867f-0f49e4873d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cfaf5039394184aca25aa7e3b283b0, user_id=895038efad2c4fac825b82b0f7e682b3, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:15.932813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee20fc-a9af-4ffd-867f-0f49e4873d51 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:15.967746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1180/2347] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:15 2022] PUT /identity/v3/projects/b0cfaf5039394184aca25aa7e3b283b0/users/895038efad2c4fac825b82b0f7e682b3/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:15.979180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb74fb-5163-4907-81f8-1da93e9cc39b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:15.979473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb74fb-5163-4907-81f8-1da93e9cc39b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:15.979755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb74fb-5163-4907-81f8-1da93e9cc39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:16.034079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c1fb74fb-5163-4907-81f8-1da93e9cc39b None None] MFA Rules not processed for user `895038efad2c4fac825b82b0f7e682b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:16.039481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c1fb74fb-5163-4907-81f8-1da93e9cc39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:16.159405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1168/2348] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:16.160598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee20fc-a9af-4ffd-867f-0f49e4873d51 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:16.162360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-81ee20fc-a9af-4ffd-867f-0f49e4873d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:16.264810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee20fc-a9af-4ffd-867f-0f49e4873d51 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:16.269322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae54a7-a838-475f-b00e-52945c9df753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:16.270751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae54a7-a838-475f-b00e-52945c9df753 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:16.270751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae54a7-a838-475f-b00e-52945c9df753 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:16.270751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae54a7-a838-475f-b00e-52945c9df753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:16.289260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae54a7-a838-475f-b00e-52945c9df753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:16.289260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae54a7-a838-475f-b00e-52945c9df753 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:16.317509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1181/2349] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:16.365760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb74fb-5163-4907-81f8-1da93e9cc39b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:16.368662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c1fb74fb-5163-4907-81f8-1da93e9cc39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:16.389359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb74fb-5163-4907-81f8-1da93e9cc39b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:16.406603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79f1cf-5089-4a6a-af81-1d178d2844dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:16.406603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f1cf-5089-4a6a-af81-1d178d2844dd service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:16.406603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f1cf-5089-4a6a-af81-1d178d2844dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:16.406603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f1cf-5089-4a6a-af81-1d178d2844dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:16.526518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79f1cf-5089-4a6a-af81-1d178d2844dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:16.528256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79f1cf-5089-4a6a-af81-1d178d2844dd service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:16.566183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1169/2350] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:21.309622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae54a7-a838-475f-b00e-52945c9df753 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:21.311724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-23ae54a7-a838-475f-b00e-52945c9df753 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:21.523740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae54a7-a838-475f-b00e-52945c9df753 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:21.536243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c0c61-406c-49f5-8bc2-5993cbdb496f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:21.536780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c0c61-406c-49f5-8bc2-5993cbdb496f service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:21.537318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c0c61-406c-49f5-8bc2-5993cbdb496f service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:21.537871 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c0c61-406c-49f5-8bc2-5993cbdb496f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:21.541951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ac5c0c61-406c-49f5-8bc2-5993cbdb496f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:21.651441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c0c61-406c-49f5-8bc2-5993cbdb496f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:21.653162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c0c61-406c-49f5-8bc2-5993cbdb496f service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:21.686027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1182/2351] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:22.215142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79f1cf-5089-4a6a-af81-1d178d2844dd service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:22.310575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79f1cf-5089-4a6a-af81-1d178d2844dd service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:22.317530 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:22.318698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:22.319217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:22.323767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] PATH_INFO: `/v3/users/b67d41236c374313aacf9621f20c0a5b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:22.323767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67d41236c374313aacf9621f20c0a5b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:22.323767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:22.564303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67d41236c374313aacf9621f20c0a5b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:22.589623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67d41236c374313aacf9621f20c0a5b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:22.591681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67d41236c374313aacf9621f20c0a5b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:22.672362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67d41236c374313aacf9621f20c0a5b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:22.683090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67d41236c374313aacf9621f20c0a5b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:22.692758 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1170/2352] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:22 2022] DELETE /identity/v3/users/b67d41236c374313aacf9621f20c0a5b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:22.694936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886dfb6-cf91-47a0-9b8c-109208fa4ab6 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:22.695460 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886dfb6-cf91-47a0-9b8c-109208fa4ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:22.695845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886dfb6-cf91-47a0-9b8c-109208fa4ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:22.716570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f886dfb6-cf91-47a0-9b8c-109208fa4ab6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:22.718785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f886dfb6-cf91-47a0-9b8c-109208fa4ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:22.813086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1183/2353] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:22.826586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:22.828212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:22.919205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a8bb2-06f6-4ede-9711-5bf11107b9c5 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:22.923536 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4823b-66d9-4fc4-ad6c-97910caf620c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:22.924088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4823b-66d9-4fc4-ad6c-97910caf620c service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:22.924383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4823b-66d9-4fc4-ad6c-97910caf620c service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:22.925179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4823b-66d9-4fc4-ad6c-97910caf620c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:22.940518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4823b-66d9-4fc4-ad6c-97910caf620c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:22.942191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4823b-66d9-4fc4-ad6c-97910caf620c service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:22.962863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1171/2354] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:23.265948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9678-d312-453c-9c89-33998e344eb7 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:23.265948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9678-d312-453c-9c89-33998e344eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:23.266253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9678-d312-453c-9c89-33998e344eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:23.300918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-c78f9678-d312-453c-9c89-33998e344eb7 None None] MFA Rules not processed for user `827d3c3570344412913fbdc764a7ce8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:23.302630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c78f9678-d312-453c-9c89-33998e344eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:23.424911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1184/2355] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:23.433416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4823b-66d9-4fc4-ad6c-97910caf620c service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:23.435498 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1cf4823b-66d9-4fc4-ad6c-97910caf620c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:23.599957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4823b-66d9-4fc4-ad6c-97910caf620c service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:23.608106 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45d0be-b636-4851-a35c-8b2345c1c643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:23.608875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d0be-b636-4851-a35c-8b2345c1c643 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:23.609232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d0be-b636-4851-a35c-8b2345c1c643 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:23.609629 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d0be-b636-4851-a35c-8b2345c1c643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:23.611502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6b45d0be-b636-4851-a35c-8b2345c1c643 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:23.676808 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45d0be-b636-4851-a35c-8b2345c1c643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:23.679128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45d0be-b636-4851-a35c-8b2345c1c643 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:23.689149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1172/2356] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:23.735080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f9678-d312-453c-9c89-33998e344eb7 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:23.737432 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c78f9678-d312-453c-9c89-33998e344eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:23.762201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f9678-d312-453c-9c89-33998e344eb7 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:23.770069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:23.772680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:23.773340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:23.774581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] PATH_INFO: `/v3/projects/18467281ad144f54b84c0844f538431a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:23.776933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18467281ad144f54b84c0844f538431a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:23.778907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:23.955589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18467281ad144f54b84c0844f538431a', 'request_id': 'req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:23.963080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18467281ad144f54b84c0844f538431a', 'request_id': 'req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:24.068325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18467281ad144f54b84c0844f538431a', 'request_id': 'req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:24.083202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] The token cache is being invalidate because project 18467281ad144f54b84c0844f538431a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:24.084168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:24.085914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0cf1dc24-a2f9-4103-b9a1-38ea783eaa46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:24.088003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1185/2357] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:23 2022] DELETE /identity/v3/projects/18467281ad144f54b84c0844f538431a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:24.093749 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45d0be-b636-4851-a35c-8b2345c1c643 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:24.108994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45d0be-b636-4851-a35c-8b2345c1c643 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:24.181703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:24.182696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:24.182996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:24.183279 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] PATH_INFO: `/v3/users/895038efad2c4fac825b82b0f7e682b3` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:24.185413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=895038efad2c4fac825b82b0f7e682b3)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:24.186911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:24.384625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895038efad2c4fac825b82b0f7e682b3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:24.400531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895038efad2c4fac825b82b0f7e682b3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:24.415570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895038efad2c4fac825b82b0f7e682b3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:24.489346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895038efad2c4fac825b82b0f7e682b3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:24.499810 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895038efad2c4fac825b82b0f7e682b3'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:24.506358 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1173/2358] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:24 2022] DELETE /identity/v3/users/895038efad2c4fac825b82b0f7e682b3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:25.040951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de9377-ec38-4e4d-93bd-bfb5c07fd42f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:25.041516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de9377-ec38-4e4d-93bd-bfb5c07fd42f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:25.041516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de9377-ec38-4e4d-93bd-bfb5c07fd42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:25.059850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f1de9377-ec38-4e4d-93bd-bfb5c07fd42f None None] MFA Rules not processed for user `606b53c6f60d45cf9e2c3e5c6c9cde2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:25.061056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f1de9377-ec38-4e4d-93bd-bfb5c07fd42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:25.125374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1186/2359] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:25.174206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:25.175634 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:25.248929 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c5ed-27bb-4f56-8e51-9d621a30bffb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:25.254851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:25.260748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:25.260748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:25.260748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] PATH_INFO: `/v3/projects/b0cfaf5039394184aca25aa7e3b283b0` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:25.260748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0cfaf5039394184aca25aa7e3b283b0)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:25.261763 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:25.471245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0cfaf5039394184aca25aa7e3b283b0', 'request_id': 'req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:25.484143 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0cfaf5039394184aca25aa7e3b283b0', 'request_id': 'req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:25.537511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de9377-ec38-4e4d-93bd-bfb5c07fd42f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:25.539224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f1de9377-ec38-4e4d-93bd-bfb5c07fd42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:25.586706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0cfaf5039394184aca25aa7e3b283b0', 'request_id': 'req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:25.615280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] The token cache is being invalidate because project b0cfaf5039394184aca25aa7e3b283b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:25.619546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:25.620865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-29cb4eb4-a310-4d28-bcc1-8dae8053f93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:25.622156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de9377-ec38-4e4d-93bd-bfb5c07fd42f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:25.627288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1174/2360] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:25 2022] DELETE /identity/v3/projects/b0cfaf5039394184aca25aa7e3b283b0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:25.629432 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f5db-ee1b-42d9-b18c-2ef764a9be55 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:25.629971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f5db-ee1b-42d9-b18c-2ef764a9be55 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:25.630304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f5db-ee1b-42d9-b18c-2ef764a9be55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:25.659762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1e42f5db-ee1b-42d9-b18c-2ef764a9be55 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:25.659762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1e42f5db-ee1b-42d9-b18c-2ef764a9be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:25.698176 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639c365-6486-4431-a8a2-92ac7159542f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:25.698843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639c365-6486-4431-a8a2-92ac7159542f service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:25.699126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639c365-6486-4431-a8a2-92ac7159542f service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:25.699491 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639c365-6486-4431-a8a2-92ac7159542f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:25.702093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b639c365-6486-4431-a8a2-92ac7159542f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:25.714438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639c365-6486-4431-a8a2-92ac7159542f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:25.716213 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639c365-6486-4431-a8a2-92ac7159542f service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:25.738081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1187/2361] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:25.745467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1175/2362] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:25.749445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e261af-f193-4c19-997f-2dfc8ef525ef None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:25.749860 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e261af-f193-4c19-997f-2dfc8ef525ef None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:25.750146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e261af-f193-4c19-997f-2dfc8ef525ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:25.774009 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-e9e261af-f193-4c19-997f-2dfc8ef525ef None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:25.775259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e9e261af-f193-4c19-997f-2dfc8ef525ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:25.785318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1188/2363] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:25.789540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42f5db-ee1b-42d9-b18c-2ef764a9be55 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:25.799930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42f5db-ee1b-42d9-b18c-2ef764a9be55 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:25.805681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4a602-608c-446f-9196-cad86969c413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:25.806713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4a602-608c-446f-9196-cad86969c413 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:25.806713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4a602-608c-446f-9196-cad86969c413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:25.807056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4a602-608c-446f-9196-cad86969c413 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:25.807706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4a602-608c-446f-9196-cad86969c413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:43:25.808451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4a602-608c-446f-9196-cad86969c413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:25.810404 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4a602-608c-446f-9196-cad86969c413 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:25.829907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1176/2364] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:43:25.832950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e261af-f193-4c19-997f-2dfc8ef525ef None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:25.848189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e261af-f193-4c19-997f-2dfc8ef525ef None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:25.866817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208e047-c3e2-44cb-8b43-33a1825728db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:25.866817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208e047-c3e2-44cb-8b43-33a1825728db admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:25.866817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208e047-c3e2-44cb-8b43-33a1825728db admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:25.866817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208e047-c3e2-44cb-8b43-33a1825728db admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:25.867328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208e047-c3e2-44cb-8b43-33a1825728db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:25.874439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208e047-c3e2-44cb-8b43-33a1825728db admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:26.047577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1189/2365] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:25 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:26.049178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4a602-608c-446f-9196-cad86969c413 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:26.071135 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4a602-608c-446f-9196-cad86969c413 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:26.145781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c464c7-eb27-4c07-a36c-e90ee068376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:26.146553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c464c7-eb27-4c07-a36c-e90ee068376c admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:26.148524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c464c7-eb27-4c07-a36c-e90ee068376c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:26.149177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c464c7-eb27-4c07-a36c-e90ee068376c admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:26.149935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c464c7-eb27-4c07-a36c-e90ee068376c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:26.151928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c464c7-eb27-4c07-a36c-e90ee068376c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:26.302541 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1177/2366] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:26 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:26.310599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208e047-c3e2-44cb-8b43-33a1825728db admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:26.323521 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208e047-c3e2-44cb-8b43-33a1825728db admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:26.329683 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d4520-7f1b-4270-821b-8d358066aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:26.331086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d4520-7f1b-4270-821b-8d358066aafd admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:26.331086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d4520-7f1b-4270-821b-8d358066aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:26.331086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d4520-7f1b-4270-821b-8d358066aafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:26.331833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d4520-7f1b-4270-821b-8d358066aafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:26.333949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d4520-7f1b-4270-821b-8d358066aafd admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:26.351603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c464c7-eb27-4c07-a36c-e90ee068376c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:26.357240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1190/2367] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:26.378712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c464c7-eb27-4c07-a36c-e90ee068376c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:26.392928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc4631-2d3b-46b3-b62c-b5005b716c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:26.393864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc4631-2d3b-46b3-b62c-b5005b716c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:26.394148 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc4631-2d3b-46b3-b62c-b5005b716c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:26.395698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc4631-2d3b-46b3-b62c-b5005b716c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:26.396486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc4631-2d3b-46b3-b62c-b5005b716c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:26.400979 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc4631-2d3b-46b3-b62c-b5005b716c11 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:26.422496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1178/2368] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:26.427138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d4520-7f1b-4270-821b-8d358066aafd admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:26.440171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d4520-7f1b-4270-821b-8d358066aafd admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:26.457550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d9406-49d7-4e9e-a3ab-efc1d96d8614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:26.458849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d9406-49d7-4e9e-a3ab-efc1d96d8614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:26.459207 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d9406-49d7-4e9e-a3ab-efc1d96d8614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:26.459554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d9406-49d7-4e9e-a3ab-efc1d96d8614 admin admin] PATH_INFO: `/v3/projects/4c94f4ded30b43209e8940db33cd7b9d/users/a43236b5fe8c4706b3a729cd5c5ad39a/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:26.499172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d9406-49d7-4e9e-a3ab-efc1d96d8614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c94f4ded30b43209e8940db33cd7b9d, user_id=a43236b5fe8c4706b3a729cd5c5ad39a, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:26.506228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d9406-49d7-4e9e-a3ab-efc1d96d8614 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:26.621818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1191/2369] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:26 2022] PUT /identity/v3/projects/4c94f4ded30b43209e8940db33cd7b9d/users/a43236b5fe8c4706b3a729cd5c5ad39a/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:26.635631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5458bc-cc4e-4659-a452-f4372f548441 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:26.636499 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5458bc-cc4e-4659-a452-f4372f548441 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:26.637729 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5458bc-cc4e-4659-a452-f4372f548441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:26.677141 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3a5458bc-cc4e-4659-a452-f4372f548441 None None] MFA Rules not processed for user `a43236b5fe8c4706b3a729cd5c5ad39a`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:26.679702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3a5458bc-cc4e-4659-a452-f4372f548441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:26.754477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1179/2370] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:26.759972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d9406-49d7-4e9e-a3ab-efc1d96d8614 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:26.846296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d9406-49d7-4e9e-a3ab-efc1d96d8614 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:26.851857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ebfb9-5035-4050-8418-898acb2df05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:26.852540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ebfb9-5035-4050-8418-898acb2df05e admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:26.855030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ebfb9-5035-4050-8418-898acb2df05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:26.855030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ebfb9-5035-4050-8418-898acb2df05e admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:26.855030 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ebfb9-5035-4050-8418-898acb2df05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:26.856687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ebfb9-5035-4050-8418-898acb2df05e admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:26.959449 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1192/2371] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:26 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:26.964306 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5458bc-cc4e-4659-a452-f4372f548441 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:26.975049 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5458bc-cc4e-4659-a452-f4372f548441 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:27.112471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bc40c-42f4-4393-be71-8817464c576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:27.113564 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bc40c-42f4-4393-be71-8817464c576d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:27.114072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bc40c-42f4-4393-be71-8817464c576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:27.114633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bc40c-42f4-4393-be71-8817464c576d admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:27.115580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bc40c-42f4-4393-be71-8817464c576d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:27.118646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bc40c-42f4-4393-be71-8817464c576d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:27.233793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1180/2372] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:26 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:27.237918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ebfb9-5035-4050-8418-898acb2df05e admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:27.257584 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ebfb9-5035-4050-8418-898acb2df05e admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:27.263698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bba96-434b-4f00-b808-5dc7e1ea03c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:27.264404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bba96-434b-4f00-b808-5dc7e1ea03c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:27.264696 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bba96-434b-4f00-b808-5dc7e1ea03c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:27.264981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bba96-434b-4f00-b808-5dc7e1ea03c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:27.265781 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bba96-434b-4f00-b808-5dc7e1ea03c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:27.267425 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bba96-434b-4f00-b808-5dc7e1ea03c2 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:27.279115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1193/2373] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:27.283413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bc40c-42f4-4393-be71-8817464c576d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:27.301839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bc40c-42f4-4393-be71-8817464c576d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:27.307779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d38716-a068-43fa-a199-e02514ae4070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:27.308804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38716-a068-43fa-a199-e02514ae4070 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:27.311070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38716-a068-43fa-a199-e02514ae4070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:27.311675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38716-a068-43fa-a199-e02514ae4070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:27.312704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d38716-a068-43fa-a199-e02514ae4070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:27.314545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d38716-a068-43fa-a199-e02514ae4070 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:27.332724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1181/2374] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:27.337816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bba96-434b-4f00-b808-5dc7e1ea03c2 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:27.348657 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bba96-434b-4f00-b808-5dc7e1ea03c2 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:27.354519 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efb06f-af95-4779-868a-662672b4b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:27.355423 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efb06f-af95-4779-868a-662672b4b911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:27.355711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efb06f-af95-4779-868a-662672b4b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:27.355995 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efb06f-af95-4779-868a-662672b4b911 admin admin] PATH_INFO: `/v3/projects/3ee13c9efd684fc2b5e48dcdf033d6c0/users/8b47a9299b55496ca2bfcf252e44f74a/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:27.372166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efb06f-af95-4779-868a-662672b4b911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee13c9efd684fc2b5e48dcdf033d6c0, user_id=8b47a9299b55496ca2bfcf252e44f74a, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:27.375480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efb06f-af95-4779-868a-662672b4b911 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:27.497371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1194/2375] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:27 2022] PUT /identity/v3/projects/3ee13c9efd684fc2b5e48dcdf033d6c0/users/8b47a9299b55496ca2bfcf252e44f74a/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:27.513845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc027-57b7-43a5-aca9-b93488dbd66c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:27.514145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc027-57b7-43a5-aca9-b93488dbd66c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:27.514424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc027-57b7-43a5-aca9-b93488dbd66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:27.565354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efb06f-af95-4779-868a-662672b4b911 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:27.565770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-50efb06f-af95-4779-868a-662672b4b911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:27.569913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3eafc027-57b7-43a5-aca9-b93488dbd66c None None] MFA Rules not processed for user `8b47a9299b55496ca2bfcf252e44f74a`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:27.571294 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3eafc027-57b7-43a5-aca9-b93488dbd66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:27.735334 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1182/2376] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:27.737511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3526-37cb-45bf-8be4-9ed54ba8ed6a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:27.738086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3526-37cb-45bf-8be4-9ed54ba8ed6a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:27.738516 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3526-37cb-45bf-8be4-9ed54ba8ed6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:27.783367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-558a3526-37cb-45bf-8be4-9ed54ba8ed6a None None] MFA Rules not processed for user `565a25c59df84a1fa6f6420093e89fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:27.787589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-558a3526-37cb-45bf-8be4-9ed54ba8ed6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:27.790104 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efb06f-af95-4779-868a-662672b4b911 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:27.797935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa7555-2d43-4543-9f1a-30cac0acb3d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:27.798853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7555-2d43-4543-9f1a-30cac0acb3d9 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:27.799275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7555-2d43-4543-9f1a-30cac0acb3d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:27.799703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7555-2d43-4543-9f1a-30cac0acb3d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:27.801895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-40fa7555-2d43-4543-9f1a-30cac0acb3d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:27.832531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa7555-2d43-4543-9f1a-30cac0acb3d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:27.837741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa7555-2d43-4543-9f1a-30cac0acb3d9 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:27.850243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1195/2377] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:43:27.851372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa7555-2d43-4543-9f1a-30cac0acb3d9 service nova] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:27.964152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1183/2378] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:27.988156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa7555-2d43-4543-9f1a-30cac0acb3d9 service nova] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:27.997243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8346db-040a-4598-8558-61fdc391296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:27.998191 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8346db-040a-4598-8558-61fdc391296d admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:27.998634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8346db-040a-4598-8558-61fdc391296d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:28.001782 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8346db-040a-4598-8558-61fdc391296d admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:28.002834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8346db-040a-4598-8558-61fdc391296d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:28.004855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8346db-040a-4598-8558-61fdc391296d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:28.130025 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1196/2379] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:27 2022] POST /identity/v3/projects => generated 379 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:28.132829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a3526-37cb-45bf-8be4-9ed54ba8ed6a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:28.171055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a3526-37cb-45bf-8be4-9ed54ba8ed6a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:28.261633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bf12d-3edd-4940-91f9-763139cab9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:28.262421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bf12d-3edd-4940-91f9-763139cab9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:28.262780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bf12d-3edd-4940-91f9-763139cab9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:28.263359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bf12d-3edd-4940-91f9-763139cab9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:28.264159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bf12d-3edd-4940-91f9-763139cab9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:28.266419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bf12d-3edd-4940-91f9-763139cab9c6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:28.360134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1184/2380] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:28 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:28.364285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8346db-040a-4598-8558-61fdc391296d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:28.384652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8346db-040a-4598-8558-61fdc391296d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:28.390642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5784147-2e38-4861-8259-899580b88107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:28.391327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5784147-2e38-4861-8259-899580b88107 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:28.391676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5784147-2e38-4861-8259-899580b88107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:28.391961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5784147-2e38-4861-8259-899580b88107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:28.392702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5784147-2e38-4861-8259-899580b88107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:28.394413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5784147-2e38-4861-8259-899580b88107 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:28.411080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bf12d-3edd-4940-91f9-763139cab9c6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:28.418688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1197/2381] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:28.422557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bf12d-3edd-4940-91f9-763139cab9c6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:28.427812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a00d2-3ec8-4823-85fe-5fd053c7da38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:28.428757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a00d2-3ec8-4823-85fe-5fd053c7da38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:28.429046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a00d2-3ec8-4823-85fe-5fd053c7da38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:28.429515 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a00d2-3ec8-4823-85fe-5fd053c7da38 admin admin] PATH_INFO: `/v3/projects/8fe07475a5d64e3c9f02c4a7786045c5/users/e237390ba1784662bc7f5e73b01c6433/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:28.448157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a00d2-3ec8-4823-85fe-5fd053c7da38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe07475a5d64e3c9f02c4a7786045c5, user_id=e237390ba1784662bc7f5e73b01c6433, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:28.451948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a00d2-3ec8-4823-85fe-5fd053c7da38 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:28.562724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5784147-2e38-4861-8259-899580b88107 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:28.562911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1185/2382] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:28 2022] PUT /identity/v3/projects/8fe07475a5d64e3c9f02c4a7786045c5/users/e237390ba1784662bc7f5e73b01c6433/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:28.574780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5784147-2e38-4861-8259-899580b88107 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:28.646784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93305295-abfd-40d8-8797-a15ca8e9a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:28.647653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305295-abfd-40d8-8797-a15ca8e9a0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:28.647939 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305295-abfd-40d8-8797-a15ca8e9a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:28.648221 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93305295-abfd-40d8-8797-a15ca8e9a0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:28.648972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93305295-abfd-40d8-8797-a15ca8e9a0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:28.650661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93305295-abfd-40d8-8797-a15ca8e9a0f2 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:28.660877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1198/2383] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:28.665829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a00d2-3ec8-4823-85fe-5fd053c7da38 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:28.676868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a00d2-3ec8-4823-85fe-5fd053c7da38 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:28.682547 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e157bf-a7af-4f12-a532-ae24287529ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:28.683441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e157bf-a7af-4f12-a532-ae24287529ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:28.683731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e157bf-a7af-4f12-a532-ae24287529ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:28.684018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e157bf-a7af-4f12-a532-ae24287529ce admin admin] PATH_INFO: `/v3/projects/8fe07475a5d64e3c9f02c4a7786045c5/users/e237390ba1784662bc7f5e73b01c6433/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:28.686076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e157bf-a7af-4f12-a532-ae24287529ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe07475a5d64e3c9f02c4a7786045c5, user_id=e237390ba1784662bc7f5e73b01c6433, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:28.688786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e157bf-a7af-4f12-a532-ae24287529ce admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:28.700250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1186/2384] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:28 2022] PUT /identity/v3/projects/8fe07475a5d64e3c9f02c4a7786045c5/users/e237390ba1784662bc7f5e73b01c6433/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:28.711799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804b8a4-302d-4743-8210-735e75d5cb0c None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:28.712223 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804b8a4-302d-4743-8210-735e75d5cb0c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:28.712569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804b8a4-302d-4743-8210-735e75d5cb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:28.752513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-7804b8a4-302d-4743-8210-735e75d5cb0c None None] MFA Rules not processed for user `e237390ba1784662bc7f5e73b01c6433`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:28.753867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7804b8a4-302d-4743-8210-735e75d5cb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:28.885450 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1199/2385] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:28.896599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e157bf-a7af-4f12-a532-ae24287529ce admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:28.898751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e7e157bf-a7af-4f12-a532-ae24287529ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:28.970082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e157bf-a7af-4f12-a532-ae24287529ce admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:28.974382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f273530-3603-40b4-bed5-02bd34484b6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:28.975053 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f273530-3603-40b4-bed5-02bd34484b6f service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:28.975454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f273530-3603-40b4-bed5-02bd34484b6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:28.975825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f273530-3603-40b4-bed5-02bd34484b6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:28.990166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f273530-3603-40b4-bed5-02bd34484b6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:28.991880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f273530-3603-40b4-bed5-02bd34484b6f service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:29.005073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1187/2386] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:29.148048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804b8a4-302d-4743-8210-735e75d5cb0c None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:29.149688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7804b8a4-302d-4743-8210-735e75d5cb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:29.166947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804b8a4-302d-4743-8210-735e75d5cb0c None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:29.171281 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c58ea5-4bd5-428b-9b7e-6a3fe907f31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:29.173087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c58ea5-4bd5-428b-9b7e-6a3fe907f31d service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:29.173578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c58ea5-4bd5-428b-9b7e-6a3fe907f31d service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:29.174024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c58ea5-4bd5-428b-9b7e-6a3fe907f31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:29.275021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c58ea5-4bd5-428b-9b7e-6a3fe907f31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:29.279113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c58ea5-4bd5-428b-9b7e-6a3fe907f31d service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:29.311296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1200/2387] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:31.058509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f273530-3603-40b4-bed5-02bd34484b6f service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:31.142743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f273530-3603-40b4-bed5-02bd34484b6f service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:31.148918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb875d-9316-461c-89b5-ddcad1b23b51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:31.149806 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb875d-9316-461c-89b5-ddcad1b23b51 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:31.150099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb875d-9316-461c-89b5-ddcad1b23b51 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:31.150378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb875d-9316-461c-89b5-ddcad1b23b51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:31.152377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3fbb875d-9316-461c-89b5-ddcad1b23b51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:31.173520 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb875d-9316-461c-89b5-ddcad1b23b51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:31.175275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb875d-9316-461c-89b5-ddcad1b23b51 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:31.188587 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1188/2388] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:33.554539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c58ea5-4bd5-428b-9b7e-6a3fe907f31d service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:33.626243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c58ea5-4bd5-428b-9b7e-6a3fe907f31d service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:33.631784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:33.632715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:33.633678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:33.633961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] PATH_INFO: `/v3/users/a43236b5fe8c4706b3a729cd5c5ad39a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:33.635211 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43236b5fe8c4706b3a729cd5c5ad39a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:33.637146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:33.790993 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43236b5fe8c4706b3a729cd5c5ad39a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:33.791645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43236b5fe8c4706b3a729cd5c5ad39a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:33.792246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43236b5fe8c4706b3a729cd5c5ad39a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:33.803869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43236b5fe8c4706b3a729cd5c5ad39a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:33.811443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43236b5fe8c4706b3a729cd5c5ad39a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:33.877815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1201/2389] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:33 2022] DELETE /identity/v3/users/a43236b5fe8c4706b3a729cd5c5ad39a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:33.878999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39255eb-7aad-4cea-baa9-ba15dfc5fd0d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:33.879508 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39255eb-7aad-4cea-baa9-ba15dfc5fd0d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:33.879592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39255eb-7aad-4cea-baa9-ba15dfc5fd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:33.898099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b39255eb-7aad-4cea-baa9-ba15dfc5fd0d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:33.899430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b39255eb-7aad-4cea-baa9-ba15dfc5fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:33.965575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1189/2390] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:33.975721 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:33.977307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:34.037200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46c98-ff3d-4582-bd4a-474e39ac8734 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:34.041490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62529d7-028f-4814-a2ca-a27c8d17e56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:34.042305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62529d7-028f-4814-a2ca-a27c8d17e56e service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:34.042648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62529d7-028f-4814-a2ca-a27c8d17e56e service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:34.042933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62529d7-028f-4814-a2ca-a27c8d17e56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:34.053754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62529d7-028f-4814-a2ca-a27c8d17e56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:34.055426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62529d7-028f-4814-a2ca-a27c8d17e56e service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:34.066213 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1202/2391] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:34.499193 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39255eb-7aad-4cea-baa9-ba15dfc5fd0d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:34.500714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b39255eb-7aad-4cea-baa9-ba15dfc5fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:34.514149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39255eb-7aad-4cea-baa9-ba15dfc5fd0d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:34.518863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:34.519734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:34.520014 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:34.520315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] PATH_INFO: `/v3/projects/4c94f4ded30b43209e8940db33cd7b9d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:34.521659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c94f4ded30b43209e8940db33cd7b9d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:34.530130 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:34.666887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c94f4ded30b43209e8940db33cd7b9d', 'request_id': 'req-f6b7e275-e968-4022-a454-fa61e7567f2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:34.673337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c94f4ded30b43209e8940db33cd7b9d', 'request_id': 'req-f6b7e275-e968-4022-a454-fa61e7567f2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:34.782262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c94f4ded30b43209e8940db33cd7b9d', 'request_id': 'req-f6b7e275-e968-4022-a454-fa61e7567f2f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:34.797539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] The token cache is being invalidate because project 4c94f4ded30b43209e8940db33cd7b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:34.797829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:34.798950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:34.800500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1190/2392] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:34 2022] DELETE /identity/v3/projects/4c94f4ded30b43209e8940db33cd7b9d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:34.804356 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62529d7-028f-4814-a2ca-a27c8d17e56e service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:34.818714 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62529d7-028f-4814-a2ca-a27c8d17e56e service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:34.881413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:34.882306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:34.882594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:34.882878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] PATH_INFO: `/v3/users/8b47a9299b55496ca2bfcf252e44f74a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:34.884201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b47a9299b55496ca2bfcf252e44f74a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:34.886190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:35.114438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b47a9299b55496ca2bfcf252e44f74a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:35.115111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b47a9299b55496ca2bfcf252e44f74a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:35.116014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b47a9299b55496ca2bfcf252e44f74a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:35.129945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b47a9299b55496ca2bfcf252e44f74a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:35.137854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b47a9299b55496ca2bfcf252e44f74a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:35.233603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1203/2393] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:34 2022] DELETE /identity/v3/users/8b47a9299b55496ca2bfcf252e44f74a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:35.717359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:35.719392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:35.734309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e275-e968-4022-a454-fa61e7567f2f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:35.794650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:35.795554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:35.795840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:35.796120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] PATH_INFO: `/v3/projects/3ee13c9efd684fc2b5e48dcdf033d6c0` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:35.797339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee13c9efd684fc2b5e48dcdf033d6c0)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:35.799423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:35.914712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee13c9efd684fc2b5e48dcdf033d6c0', 'request_id': 'req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:35.921126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee13c9efd684fc2b5e48dcdf033d6c0', 'request_id': 'req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:35.979976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee13c9efd684fc2b5e48dcdf033d6c0', 'request_id': 'req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:35.992454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] The token cache is being invalidate because project 3ee13c9efd684fc2b5e48dcdf033d6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:35.992822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:35.993968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:35.995781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1191/2394] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:35 2022] DELETE /identity/v3/projects/3ee13c9efd684fc2b5e48dcdf033d6c0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:35.999730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:36.001186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:36.014967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584175d7-175d-4695-baee-29a7626ed3d8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:36.074879 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:36.075761 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:36.076123 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:36.076399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] PATH_INFO: `/v3/users/e237390ba1784662bc7f5e73b01c6433` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:36.077670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e237390ba1784662bc7f5e73b01c6433)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:36.079572 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:36.275825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e237390ba1784662bc7f5e73b01c6433'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:36.276528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e237390ba1784662bc7f5e73b01c6433'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:36.277146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e237390ba1784662bc7f5e73b01c6433'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:36.290073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e237390ba1784662bc7f5e73b01c6433'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:36.298411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ab08235-73d6-4ecb-b54d-94d040ba29f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e237390ba1784662bc7f5e73b01c6433'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:36.359640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1204/2395] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:35 2022] DELETE /identity/v3/users/e237390ba1784662bc7f5e73b01c6433 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:36.818660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:36.820105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:36.834777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c37779-0c33-4f43-8ad8-3bb36eed8a1e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:36.895945 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:36.897299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:36.897697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:36.898159 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] PATH_INFO: `/v3/projects/8fe07475a5d64e3c9f02c4a7786045c5` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:36.899785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe07475a5d64e3c9f02c4a7786045c5)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:36.902801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:37.029194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe07475a5d64e3c9f02c4a7786045c5', 'request_id': 'req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:37.034613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe07475a5d64e3c9f02c4a7786045c5', 'request_id': 'req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:37.131179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe07475a5d64e3c9f02c4a7786045c5', 'request_id': 'req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:37.143853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] The token cache is being invalidate because project 8fe07475a5d64e3c9f02c4a7786045c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:37.144201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:37.144859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3434a75f-ccea-4f16-bfff-b2d6799a4ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:37.146467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1192/2396] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:36 2022] DELETE /identity/v3/projects/8fe07475a5d64e3c9f02c4a7786045c5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:37.153245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8005-f31d-4b5f-bd90-e9d1fd2670d7 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:37.153796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8005-f31d-4b5f-bd90-e9d1fd2670d7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:37.153894 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f8005-f31d-4b5f-bd90-e9d1fd2670d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:37.173172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a52f8005-f31d-4b5f-bd90-e9d1fd2670d7 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:37.174429 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a52f8005-f31d-4b5f-bd90-e9d1fd2670d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:37.252283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1205/2397] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:37.254314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2dea-b4d7-4edd-b2a8-aa0c843e41cb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:37.254681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2dea-b4d7-4edd-b2a8-aa0c843e41cb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:37.255039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e2dea-b4d7-4edd-b2a8-aa0c843e41cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:37.273440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-358e2dea-b4d7-4edd-b2a8-aa0c843e41cb None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:37.274641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-358e2dea-b4d7-4edd-b2a8-aa0c843e41cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:37.284250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1193/2398] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:37.287437 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f8005-f31d-4b5f-bd90-e9d1fd2670d7 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:37.297735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f8005-f31d-4b5f-bd90-e9d1fd2670d7 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:37.303557 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e668b-b5ab-4cce-aec6-46b2dfce31f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:37.304245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e668b-b5ab-4cce-aec6-46b2dfce31f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:37.304533 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e668b-b5ab-4cce-aec6-46b2dfce31f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:37.304814 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e668b-b5ab-4cce-aec6-46b2dfce31f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:37.305931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e668b-b5ab-4cce-aec6-46b2dfce31f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:43:37.306249 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e668b-b5ab-4cce-aec6-46b2dfce31f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:37.308339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e668b-b5ab-4cce-aec6-46b2dfce31f0 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:37.325541 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1206/2399] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 20:43:37.326594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2dea-b4d7-4edd-b2a8-aa0c843e41cb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:37.335949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e2dea-b4d7-4edd-b2a8-aa0c843e41cb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:37.341360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12699e-1077-4df0-8d3b-fd7341ad6cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:37.342024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12699e-1077-4df0-8d3b-fd7341ad6cde admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:37.342307 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12699e-1077-4df0-8d3b-fd7341ad6cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:37.342584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12699e-1077-4df0-8d3b-fd7341ad6cde admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:37.343296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12699e-1077-4df0-8d3b-fd7341ad6cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:37.345177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12699e-1077-4df0-8d3b-fd7341ad6cde admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:37.441663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1194/2400] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:37 2022] POST /identity/v3/projects => generated 361 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:37.445713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e668b-b5ab-4cce-aec6-46b2dfce31f0 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:37.455952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e668b-b5ab-4cce-aec6-46b2dfce31f0 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:37.529340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12699e-1077-4df0-8d3b-fd7341ad6cde admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:37.532229 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cf12699e-1077-4df0-8d3b-fd7341ad6cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:37.536098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454a913-f459-43b6-adb3-cf1e9419a369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:37.536098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454a913-f459-43b6-adb3-cf1e9419a369 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:37.536098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454a913-f459-43b6-adb3-cf1e9419a369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:37.537215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454a913-f459-43b6-adb3-cf1e9419a369 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:37.538028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454a913-f459-43b6-adb3-cf1e9419a369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:37.551246 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454a913-f459-43b6-adb3-cf1e9419a369 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:37.654472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12699e-1077-4df0-8d3b-fd7341ad6cde admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:37.662219 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4a9c5-00c0-42e0-837c-54db06841042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:37.665958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4a9c5-00c0-42e0-837c-54db06841042 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:37.665958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4a9c5-00c0-42e0-837c-54db06841042 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:37.665958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4a9c5-00c0-42e0-837c-54db06841042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:37.668350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e1b4a9c5-00c0-42e0-837c-54db06841042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:37.683003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4a9c5-00c0-42e0-837c-54db06841042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:37.684605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4a9c5-00c0-42e0-837c-54db06841042 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:37.704615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1195/2401] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:43:37.730502 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1207/2402] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:37 2022] POST /identity/v3/users => generated 281 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:37.740918 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4a9c5-00c0-42e0-837c-54db06841042 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:37.753494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4a9c5-00c0-42e0-837c-54db06841042 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:37.758440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41395bdb-1af6-4882-b714-1c5d302a0fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:37.759106 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41395bdb-1af6-4882-b714-1c5d302a0fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:37.759391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41395bdb-1af6-4882-b714-1c5d302a0fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:37.759668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41395bdb-1af6-4882-b714-1c5d302a0fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:37.760436 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41395bdb-1af6-4882-b714-1c5d302a0fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:37.762325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41395bdb-1af6-4882-b714-1c5d302a0fb2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:37.773501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1196/2403] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:37.778034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454a913-f459-43b6-adb3-cf1e9419a369 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:37.794355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454a913-f459-43b6-adb3-cf1e9419a369 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:37.799665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe35c-e58b-443d-a925-198d4c2312fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:37.800439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe35c-e58b-443d-a925-198d4c2312fa admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:37.800793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe35c-e58b-443d-a925-198d4c2312fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:37.801158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe35c-e58b-443d-a925-198d4c2312fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:37.801999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fe35c-e58b-443d-a925-198d4c2312fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:37.806195 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fe35c-e58b-443d-a925-198d4c2312fa admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:37.827311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1208/2404] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:43:37.831899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41395bdb-1af6-4882-b714-1c5d302a0fb2 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:37.843972 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41395bdb-1af6-4882-b714-1c5d302a0fb2 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:37.849853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e4ee5-e313-4be2-a227-d89bca295076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:37.851414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e4ee5-e313-4be2-a227-d89bca295076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:37.851642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e4ee5-e313-4be2-a227-d89bca295076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:37.851931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e4ee5-e313-4be2-a227-d89bca295076 admin admin] PATH_INFO: `/v3/projects/b28879eb26274cd3b6f4af84ad396459/users/f575833b09494edbb504a74d71000834/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:37.874249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e4ee5-e313-4be2-a227-d89bca295076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28879eb26274cd3b6f4af84ad396459, user_id=f575833b09494edbb504a74d71000834, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:37.877444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e4ee5-e313-4be2-a227-d89bca295076 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:37.965803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1197/2405] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:37 2022] PUT /identity/v3/projects/b28879eb26274cd3b6f4af84ad396459/users/f575833b09494edbb504a74d71000834/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 20:43:37.979600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d3347-ee43-4253-bf29-080d40bc6d59 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:37.979896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d3347-ee43-4253-bf29-080d40bc6d59 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:37.980185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d3347-ee43-4253-bf29-080d40bc6d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:38.008233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-188d3347-ee43-4253-bf29-080d40bc6d59 None None] MFA Rules not processed for user `f575833b09494edbb504a74d71000834`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:38.009534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-188d3347-ee43-4253-bf29-080d40bc6d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:38.077999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1209/2406] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:38.114889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e4ee5-e313-4be2-a227-d89bca295076 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:38.116839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-804e4ee5-e313-4be2-a227-d89bca295076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:38.190027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e4ee5-e313-4be2-a227-d89bca295076 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:38.194460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66e903-658d-41e2-b8b1-c1372bae6042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:38.195212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66e903-658d-41e2-b8b1-c1372bae6042 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:38.195556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66e903-658d-41e2-b8b1-c1372bae6042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:38.195847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66e903-658d-41e2-b8b1-c1372bae6042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:38.205511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66e903-658d-41e2-b8b1-c1372bae6042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:38.207005 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66e903-658d-41e2-b8b1-c1372bae6042 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:38.217748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1198/2407] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:43:38.232967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d3347-ee43-4253-bf29-080d40bc6d59 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:38.263527 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f023d9-0b73-432f-a96d-0ffb7f3b27bc None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:38.263826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f023d9-0b73-432f-a96d-0ffb7f3b27bc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:38.264111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f023d9-0b73-432f-a96d-0ffb7f3b27bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:38.284857 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e9f023d9-0b73-432f-a96d-0ffb7f3b27bc None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:38.286098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e9f023d9-0b73-432f-a96d-0ffb7f3b27bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:38.310157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d3347-ee43-4253-bf29-080d40bc6d59 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:38.315014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:38.316692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:38.317264 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:38.317727 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] PATH_INFO: `/v3/users/f575833b09494edbb504a74d71000834` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:38.322127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f575833b09494edbb504a74d71000834)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:38.325416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:38.351711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1199/2408] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:43:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:43:38.376401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f023d9-0b73-432f-a96d-0ffb7f3b27bc None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:38.377858 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e9f023d9-0b73-432f-a96d-0ffb7f3b27bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:38.451742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f023d9-0b73-432f-a96d-0ffb7f3b27bc None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:38.457663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee9c27-8c21-4284-b406-f15207cef7e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:38.458487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9c27-8c21-4284-b406-f15207cef7e1 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:38.458884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9c27-8c21-4284-b406-f15207cef7e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:38.459212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee9c27-8c21-4284-b406-f15207cef7e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:38.468766 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee9c27-8c21-4284-b406-f15207cef7e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:38.470392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee9c27-8c21-4284-b406-f15207cef7e1 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:38.479473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1200/2409] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 20:43:38.528776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f575833b09494edbb504a74d71000834'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:38.529692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f575833b09494edbb504a74d71000834'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:38.530293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f575833b09494edbb504a74d71000834'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:38.547763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f575833b09494edbb504a74d71000834'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:38.555372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f575833b09494edbb504a74d71000834'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:38.632382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1210/2410] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:43:38 2022] DELETE /identity/v3/users/f575833b09494edbb504a74d71000834 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:38.641630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1742c7-4a64-451c-a174-dcfeb9468482 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:38.641630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1742c7-4a64-451c-a174-dcfeb9468482 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:38.642125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1742c7-4a64-451c-a174-dcfeb9468482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:38.668518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4c1742c7-4a64-451c-a174-dcfeb9468482 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:38.670716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4c1742c7-4a64-451c-a174-dcfeb9468482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:38.758255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1201/2411] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:43:38.772571 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:38.776026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:38.848043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76be72-8997-4a0f-b1ff-e70cd5d861e1 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:38.856201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e6571-3741-49af-b5a1-8afc1d323512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:38.856886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e6571-3741-49af-b5a1-8afc1d323512 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:38.857239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e6571-3741-49af-b5a1-8afc1d323512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:38.857527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e6571-3741-49af-b5a1-8afc1d323512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:38.878457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e6571-3741-49af-b5a1-8afc1d323512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:38.881217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e6571-3741-49af-b5a1-8afc1d323512 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:38.897240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1211/2412] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:43:39.351374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1742c7-4a64-451c-a174-dcfeb9468482 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:39.353603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4c1742c7-4a64-451c-a174-dcfeb9468482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:39.375860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1742c7-4a64-451c-a174-dcfeb9468482 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:39.382234 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:39.383482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:39.385580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:39.387269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] PATH_INFO: `/v3/projects/b28879eb26274cd3b6f4af84ad396459` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:39.388830 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28879eb26274cd3b6f4af84ad396459)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:39.391023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:39.542323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28879eb26274cd3b6f4af84ad396459', 'request_id': 'req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:39.550934 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28879eb26274cd3b6f4af84ad396459', 'request_id': 'req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:39.639023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28879eb26274cd3b6f4af84ad396459', 'request_id': 'req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:39.656813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] The token cache is being invalidate because project b28879eb26274cd3b6f4af84ad396459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:43:39.657639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:39.658475 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f28cd0aa-5b8d-40f9-b299-f8c8203a4f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:43:39.660764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1202/2413] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:43:39 2022] DELETE /identity/v3/projects/b28879eb26274cd3b6f4af84ad396459 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:39.665821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646067-e2d8-4c8c-b1d3-34f259bdbcb4 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:39.666351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646067-e2d8-4c8c-b1d3-34f259bdbcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:39.666351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646067-e2d8-4c8c-b1d3-34f259bdbcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:39.697659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-26646067-e2d8-4c8c-b1d3-34f259bdbcb4 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:39.699424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-26646067-e2d8-4c8c-b1d3-34f259bdbcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:39.784204 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1212/2414] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:39.792271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc286-9b70-4a42-adc0-5d987dc74b4c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:39.792271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc286-9b70-4a42-adc0-5d987dc74b4c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:39.792271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc286-9b70-4a42-adc0-5d987dc74b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:39.812637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4a6fc286-9b70-4a42-adc0-5d987dc74b4c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:39.814075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4a6fc286-9b70-4a42-adc0-5d987dc74b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:39.829505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646067-e2d8-4c8c-b1d3-34f259bdbcb4 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:39.840465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646067-e2d8-4c8c-b1d3-34f259bdbcb4 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:39.841391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1203/2415] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:39.846165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd8fdd-91fe-46bb-9b3e-4f11b506b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:39.847300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd8fdd-91fe-46bb-9b3e-4f11b506b9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:39.847909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd8fdd-91fe-46bb-9b3e-4f11b506b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:39.848554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd8fdd-91fe-46bb-9b3e-4f11b506b9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:39.849598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd8fdd-91fe-46bb-9b3e-4f11b506b9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 20:43:39.849969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd8fdd-91fe-46bb-9b3e-4f11b506b9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:39.851617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd8fdd-91fe-46bb-9b3e-4f11b506b9d3 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:39.866313 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1213/2416] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 20:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 20:43:39.876834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fc286-9b70-4a42-adc0-5d987dc74b4c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:39.889693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fc286-9b70-4a42-adc0-5d987dc74b4c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:39.895332 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da64ce-6fb8-49e5-b0a8-84085a34d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:39.896073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da64ce-6fb8-49e5-b0a8-84085a34d85a admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:39.896428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da64ce-6fb8-49e5-b0a8-84085a34d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:39.896785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da64ce-6fb8-49e5-b0a8-84085a34d85a admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:39.897603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da64ce-6fb8-49e5-b0a8-84085a34d85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:39.899604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da64ce-6fb8-49e5-b0a8-84085a34d85a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:40.043721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1204/2417] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 20:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:40.047735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd8fdd-91fe-46bb-9b3e-4f11b506b9d3 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:40.060963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd8fdd-91fe-46bb-9b3e-4f11b506b9d3 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:40.125780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85649af7-4c55-4ffa-8b21-e39c93ba1d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:40.126477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85649af7-4c55-4ffa-8b21-e39c93ba1d84 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:40.126772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85649af7-4c55-4ffa-8b21-e39c93ba1d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:40.127053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85649af7-4c55-4ffa-8b21-e39c93ba1d84 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:40.127755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85649af7-4c55-4ffa-8b21-e39c93ba1d84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:40.130121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85649af7-4c55-4ffa-8b21-e39c93ba1d84 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:40.236052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1214/2418] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 20:43:40 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 20:43:40.237398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da64ce-6fb8-49e5-b0a8-84085a34d85a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:40.250197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da64ce-6fb8-49e5-b0a8-84085a34d85a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:40.256801 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103d922-4df8-4491-a929-61daa29ba152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:40.257517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103d922-4df8-4491-a929-61daa29ba152 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:40.257806 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103d922-4df8-4491-a929-61daa29ba152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:40.258086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103d922-4df8-4491-a929-61daa29ba152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:40.259365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103d922-4df8-4491-a929-61daa29ba152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:40.261260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103d922-4df8-4491-a929-61daa29ba152 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:40.274663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1205/2419] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 20:43:40.279329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85649af7-4c55-4ffa-8b21-e39c93ba1d84 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:40.295564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85649af7-4c55-4ffa-8b21-e39c93ba1d84 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:40.300749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487876a1-2cf3-4a2d-a94b-8e8cfd948ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:40.301453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487876a1-2cf3-4a2d-a94b-8e8cfd948ace admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:40.301739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487876a1-2cf3-4a2d-a94b-8e8cfd948ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:40.302014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487876a1-2cf3-4a2d-a94b-8e8cfd948ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:40.302853 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487876a1-2cf3-4a2d-a94b-8e8cfd948ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:40.306381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487876a1-2cf3-4a2d-a94b-8e8cfd948ace admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:40.317332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1215/2420] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 20:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 20:43:40.320812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103d922-4df8-4491-a929-61daa29ba152 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:40.336123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103d922-4df8-4491-a929-61daa29ba152 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:40.341032 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa05746-b7b7-4142-9bc2-fc823379a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:40.342378 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa05746-b7b7-4142-9bc2-fc823379a179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:40.342675 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa05746-b7b7-4142-9bc2-fc823379a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:40.343452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa05746-b7b7-4142-9bc2-fc823379a179 admin admin] PATH_INFO: `/v3/projects/fd3f403a1bdf48db8bec832b39b8f391/users/b4df001beaca4de2a8e15c26b31a9168/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:40.360837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa05746-b7b7-4142-9bc2-fc823379a179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3f403a1bdf48db8bec832b39b8f391, user_id=b4df001beaca4de2a8e15c26b31a9168, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:40.363715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa05746-b7b7-4142-9bc2-fc823379a179 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:40.456698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1206/2421] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 20:43:40 2022] PUT /identity/v3/projects/fd3f403a1bdf48db8bec832b39b8f391/users/b4df001beaca4de2a8e15c26b31a9168/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:43:40.465092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a417-3f6d-4f1b-8838-885040dcad79 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:40.465092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a417-3f6d-4f1b-8838-885040dcad79 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:40.465092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a417-3f6d-4f1b-8838-885040dcad79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:40.500228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-76e1a417-3f6d-4f1b-8838-885040dcad79 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:40.502961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-76e1a417-3f6d-4f1b-8838-885040dcad79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:40.575984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1216/2422] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:40.582317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa05746-b7b7-4142-9bc2-fc823379a179 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:40.584577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8aa05746-b7b7-4142-9bc2-fc823379a179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:40.657295 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa05746-b7b7-4142-9bc2-fc823379a179 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:40.661333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fa1bc-9ad2-4ca5-985c-d07442a98fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:40.661997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa1bc-9ad2-4ca5-985c-d07442a98fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:40.662552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa1bc-9ad2-4ca5-985c-d07442a98fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:40.662836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa1bc-9ad2-4ca5-985c-d07442a98fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:40.679268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fa1bc-9ad2-4ca5-985c-d07442a98fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:40.680705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fa1bc-9ad2-4ca5-985c-d07442a98fc2 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:40.700188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1207/2423] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:43:42.908466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0beb1-08bd-485c-a1ff-973180be518f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:42.910189 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0beb1-08bd-485c-a1ff-973180be518f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:42.911069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0beb1-08bd-485c-a1ff-973180be518f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:42.970097 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-95d0beb1-08bd-485c-a1ff-973180be518f None None] MFA Rules not processed for user `b4df001beaca4de2a8e15c26b31a9168`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:42.972369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-95d0beb1-08bd-485c-a1ff-973180be518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:43.082511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1217/2424] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:43:43.103069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fa1bc-9ad2-4ca5-985c-d07442a98fc2 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:43.105858 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-662fa1bc-9ad2-4ca5-985c-d07442a98fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:43.194905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fa1bc-9ad2-4ca5-985c-d07442a98fc2 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:43.216631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a726c-8369-4112-83fd-11d5f6ad5311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:43.218787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a726c-8369-4112-83fd-11d5f6ad5311 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:43.219320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a726c-8369-4112-83fd-11d5f6ad5311 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:43.220099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a726c-8369-4112-83fd-11d5f6ad5311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:43.232222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a726c-8369-4112-83fd-11d5f6ad5311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:43.234040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a726c-8369-4112-83fd-11d5f6ad5311 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:43.253409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1208/2425] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:44.611666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0beb1-08bd-485c-a1ff-973180be518f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:43:44.613382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-95d0beb1-08bd-485c-a1ff-973180be518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:44.632003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0beb1-08bd-485c-a1ff-973180be518f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:43:44.637749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804f51-0a27-4a14-b22c-443346a312fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:43:44.641232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804f51-0a27-4a14-b22c-443346a312fa service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:44.644582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804f51-0a27-4a14-b22c-443346a312fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:44.645777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804f51-0a27-4a14-b22c-443346a312fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:44.649857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ef804f51-0a27-4a14-b22c-443346a312fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:44.661840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804f51-0a27-4a14-b22c-443346a312fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:43:44.663718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804f51-0a27-4a14-b22c-443346a312fa service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:43:44.676441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1218/2426] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:43:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:43:45.180157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e9d58-879c-49ce-a3a1-dfe65c2fb08f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:43:45.180869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e9d58-879c-49ce-a3a1-dfe65c2fb08f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:43:45.180869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e9d58-879c-49ce-a3a1-dfe65c2fb08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:43:45.200774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-762e9d58-879c-49ce-a3a1-dfe65c2fb08f None None] MFA Rules not processed for user `b4df001beaca4de2a8e15c26b31a9168`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:43:45.202035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-762e9d58-879c-49ce-a3a1-dfe65c2fb08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:43:45.209593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1209/2427] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 20:43:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 20:44:01.801083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119a1ec-9692-4af3-a4a5-0d8303f1cc50 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:44:01.801626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119a1ec-9692-4af3-a4a5-0d8303f1cc50 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:44:01.801810 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119a1ec-9692-4af3-a4a5-0d8303f1cc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:44:01.821197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-9119a1ec-9692-4af3-a4a5-0d8303f1cc50 None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:44:01.822522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9119a1ec-9692-4af3-a4a5-0d8303f1cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:44:01.884713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1219/2428] 10.222.0.59 () {58 vars in 1009 bytes} [Thu May 12 20:44:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:44:01.898409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e9d58-879c-49ce-a3a1-dfe65c2fb08f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:44:01.899905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-762e9d58-879c-49ce-a3a1-dfe65c2fb08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:44:01.986583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e9d58-879c-49ce-a3a1-dfe65c2fb08f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:44:01.992027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51909250-bf19-4b55-a694-10415a370056 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:44:01.992732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909250-bf19-4b55-a694-10415a370056 service swift] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:44:01.993024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909250-bf19-4b55-a694-10415a370056 service swift] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:44:01.993336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909250-bf19-4b55-a694-10415a370056 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:44:02.004120 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51909250-bf19-4b55-a694-10415a370056 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:44:02.006206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51909250-bf19-4b55-a694-10415a370056 service swift] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:44:02.016411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1210/2429] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:44:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:44:16.761740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119a1ec-9692-4af3-a4a5-0d8303f1cc50 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:44:16.773314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119a1ec-9692-4af3-a4a5-0d8303f1cc50 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:44:16.777194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddb2c2-9f3b-4794-b66c-30d28e6ecb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:44:16.777955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddb2c2-9f3b-4794-b66c-30d28e6ecb6e service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:44:16.778468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddb2c2-9f3b-4794-b66c-30d28e6ecb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:44:16.778586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddb2c2-9f3b-4794-b66c-30d28e6ecb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:44:16.780310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-60ddb2c2-9f3b-4794-b66c-30d28e6ecb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:44:16.856093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddb2c2-9f3b-4794-b66c-30d28e6ecb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:44:16.857888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddb2c2-9f3b-4794-b66c-30d28e6ecb6e service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:44:16.868014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1220/2430] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:44:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:44:19.876853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16e4d-78f5-47e7-a4c4-faf557c26c3c None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:44:19.877415 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16e4d-78f5-47e7-a4c4-faf557c26c3c None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:44:19.877501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16e4d-78f5-47e7-a4c4-faf557c26c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:44:19.896222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-bcd16e4d-78f5-47e7-a4c4-faf557c26c3c None None] MFA Rules not processed for user `650c0f54ab04442dba1af80d84417da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 20:44:19.897574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bcd16e4d-78f5-47e7-a4c4-faf557c26c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:44:19.906328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1211/2431] 10.222.0.59 () {58 vars in 967 bytes} [Thu May 12 20:44:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 20:44:19.922011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddb2c2-9f3b-4794-b66c-30d28e6ecb6e service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:44:19.933786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddb2c2-9f3b-4794-b66c-30d28e6ecb6e service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:44:19.940488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8192b-d104-4732-9f78-6a21303d8cc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766497e7e0614adea5769b05f0c1cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:44:19.941414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8192b-d104-4732-9f78-6a21303d8cc5 service swift] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:44:19.941882 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8192b-d104-4732-9f78-6a21303d8cc5 service swift] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:44:19.942158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8192b-d104-4732-9f78-6a21303d8cc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:44:19.951477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8192b-d104-4732-9f78-6a21303d8cc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:44:19.953322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8192b-d104-4732-9f78-6a21303d8cc5 service swift] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:44:19.961799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1221/2432] 10.222.0.59 () {60 vars in 1384 bytes} [Thu May 12 20:44:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 20:44:22.791162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16e4d-78f5-47e7-a4c4-faf557c26c3c None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:44:22.792698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-bcd16e4d-78f5-47e7-a4c4-faf557c26c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:44:22.804162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16e4d-78f5-47e7-a4c4-faf557c26c3c None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:44:22.807715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075da76-ae0d-41d9-9b9a-508ac84d5d01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:44:22.808359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075da76-ae0d-41d9-9b9a-508ac84d5d01 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:44:22.808644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075da76-ae0d-41d9-9b9a-508ac84d5d01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:44:22.808927 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075da76-ae0d-41d9-9b9a-508ac84d5d01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:44:22.810669 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b075da76-ae0d-41d9-9b9a-508ac84d5d01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:44:22.869451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075da76-ae0d-41d9-9b9a-508ac84d5d01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:44:22.870919 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075da76-ae0d-41d9-9b9a-508ac84d5d01 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:44:22.880255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1212/2433] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:44:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:47:04.165075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8192b-d104-4732-9f78-6a21303d8cc5 service swift] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:47:04.167062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1bd8192b-d104-4732-9f78-6a21303d8cc5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:47:04.234043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8192b-d104-4732-9f78-6a21303d8cc5 service swift] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:47:04.239118 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5314fc-afe7-4f75-a46c-d2f5d2f18b73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:47:04.239766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5314fc-afe7-4f75-a46c-d2f5d2f18b73 service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:47:04.240050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5314fc-afe7-4f75-a46c-d2f5d2f18b73 service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:47:04.240329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5314fc-afe7-4f75-a46c-d2f5d2f18b73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:47:04.242124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0a5314fc-afe7-4f75-a46c-d2f5d2f18b73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:47:04.253187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5314fc-afe7-4f75-a46c-d2f5d2f18b73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:47:04.255294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5314fc-afe7-4f75-a46c-d2f5d2f18b73 service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:47:04.265146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1222/2434] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:47:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:47:56.750452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075da76-ae0d-41d9-9b9a-508ac84d5d01 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:47:56.760350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075da76-ae0d-41d9-9b9a-508ac84d5d01 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:47:56.763991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8472d2-b2be-43ea-8e16-89fa24ac8d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:47:56.764668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8472d2-b2be-43ea-8e16-89fa24ac8d21 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:47:56.764949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8472d2-b2be-43ea-8e16-89fa24ac8d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:47:56.765368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8472d2-b2be-43ea-8e16-89fa24ac8d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:47:56.767169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5d8472d2-b2be-43ea-8e16-89fa24ac8d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:47:56.839317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8472d2-b2be-43ea-8e16-89fa24ac8d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:47:56.840757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8472d2-b2be-43ea-8e16-89fa24ac8d21 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:47:56.852479 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1213/2435] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:47:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:48:00.373857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5314fc-afe7-4f75-a46c-d2f5d2f18b73 service placement] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:48:00.384374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5314fc-afe7-4f75-a46c-d2f5d2f18b73 service placement] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:48:00.387970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301730e-006a-467f-90df-ebe9c6d09946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:48:00.388624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301730e-006a-467f-90df-ebe9c6d09946 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:48:00.388913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301730e-006a-467f-90df-ebe9c6d09946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:48:00.389194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301730e-006a-467f-90df-ebe9c6d09946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:48:00.391088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e301730e-006a-467f-90df-ebe9c6d09946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:48:00.404699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301730e-006a-467f-90df-ebe9c6d09946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:48:00.406168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301730e-006a-467f-90df-ebe9c6d09946 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:48:00.418082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1223/2436] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:48:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:48:24.412570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8472d2-b2be-43ea-8e16-89fa24ac8d21 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:48:24.414121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5d8472d2-b2be-43ea-8e16-89fa24ac8d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:48:24.428430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8472d2-b2be-43ea-8e16-89fa24ac8d21 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:48:24.434094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fbdb5-1654-4052-a1b1-9f5210945703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:48:24.434732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fbdb5-1654-4052-a1b1-9f5210945703 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:48:24.435021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fbdb5-1654-4052-a1b1-9f5210945703 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:48:24.435296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fbdb5-1654-4052-a1b1-9f5210945703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:48:24.437010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-090fbdb5-1654-4052-a1b1-9f5210945703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:48:24.495367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fbdb5-1654-4052-a1b1-9f5210945703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:48:24.496933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fbdb5-1654-4052-a1b1-9f5210945703 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:48:24.505743 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1214/2437] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:48:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:48:29.787250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301730e-006a-467f-90df-ebe9c6d09946 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:48:29.796432 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301730e-006a-467f-90df-ebe9c6d09946 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:48:29.800052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055317-dd50-414d-9bbb-d896bb6cb620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:48:29.800693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055317-dd50-414d-9bbb-d896bb6cb620 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:48:29.800982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055317-dd50-414d-9bbb-d896bb6cb620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:48:29.801297 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055317-dd50-414d-9bbb-d896bb6cb620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:48:29.803064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d7055317-dd50-414d-9bbb-d896bb6cb620 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:48:29.883389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7055317-dd50-414d-9bbb-d896bb6cb620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:48:29.884835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7055317-dd50-414d-9bbb-d896bb6cb620 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:48:29.903489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1224/2438] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:48:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:48:29.946262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fbdb5-1654-4052-a1b1-9f5210945703 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:48:29.955279 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fbdb5-1654-4052-a1b1-9f5210945703 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:48:29.958936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7597ae0-a61c-4da7-a751-199a9a7e6deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:48:29.960139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7597ae0-a61c-4da7-a751-199a9a7e6deb service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:48:29.960389 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7597ae0-a61c-4da7-a751-199a9a7e6deb service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:48:29.960673 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7597ae0-a61c-4da7-a751-199a9a7e6deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:48:29.962476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f7597ae0-a61c-4da7-a751-199a9a7e6deb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:48:30.041522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7597ae0-a61c-4da7-a751-199a9a7e6deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:48:30.042947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7597ae0-a61c-4da7-a751-199a9a7e6deb service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:48:30.060925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1215/2439] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:48:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:49:08.838946 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055317-dd50-414d-9bbb-d896bb6cb620 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:49:08.848170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055317-dd50-414d-9bbb-d896bb6cb620 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:49:08.852504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe747f64-c771-4dfb-a424-9841a45aaa79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:49:08.853148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe747f64-c771-4dfb-a424-9841a45aaa79 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:49:08.853465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe747f64-c771-4dfb-a424-9841a45aaa79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:49:08.853746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe747f64-c771-4dfb-a424-9841a45aaa79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:49:08.855532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-fe747f64-c771-4dfb-a424-9841a45aaa79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:49:08.865379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe747f64-c771-4dfb-a424-9841a45aaa79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:49:08.866819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe747f64-c771-4dfb-a424-9841a45aaa79 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:49:08.875055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1225/2440] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:49:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:49:25.921503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7597ae0-a61c-4da7-a751-199a9a7e6deb service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:49:25.930450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7597ae0-a61c-4da7-a751-199a9a7e6deb service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:49:25.934206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51df65-c5d4-40e1-b927-313ea7aa1ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:49:25.934927 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51df65-c5d4-40e1-b927-313ea7aa1ddc service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:49:25.935212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51df65-c5d4-40e1-b927-313ea7aa1ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:49:25.935491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51df65-c5d4-40e1-b927-313ea7aa1ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:49:25.950611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51df65-c5d4-40e1-b927-313ea7aa1ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:49:25.952456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51df65-c5d4-40e1-b927-313ea7aa1ddc service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:49:25.980203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1216/2441] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:49:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:49:26.028622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe747f64-c771-4dfb-a424-9841a45aaa79 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:49:26.037897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe747f64-c771-4dfb-a424-9841a45aaa79 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:49:26.041539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eeafb-bab3-41f8-9720-f671fc9e1218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:49:26.042173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eeafb-bab3-41f8-9720-f671fc9e1218 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:49:26.042457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eeafb-bab3-41f8-9720-f671fc9e1218 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:49:26.042736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eeafb-bab3-41f8-9720-f671fc9e1218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:49:26.053338 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eeafb-bab3-41f8-9720-f671fc9e1218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:49:26.054818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eeafb-bab3-41f8-9720-f671fc9e1218 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:49:26.063720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1226/2442] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:49:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:50:33.511183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51df65-c5d4-40e1-b927-313ea7aa1ddc service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:50:33.514596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ee51df65-c5d4-40e1-b927-313ea7aa1ddc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:50:33.616314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51df65-c5d4-40e1-b927-313ea7aa1ddc service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:50:33.624443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b42145-1ad9-4698-9855-41627ee6106e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:50:33.625051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42145-1ad9-4698-9855-41627ee6106e service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:50:33.625390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42145-1ad9-4698-9855-41627ee6106e service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:50:33.625703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42145-1ad9-4698-9855-41627ee6106e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:50:33.627548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d1b42145-1ad9-4698-9855-41627ee6106e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:50:33.646674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b42145-1ad9-4698-9855-41627ee6106e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:50:33.650513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b42145-1ad9-4698-9855-41627ee6106e service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:50:33.663163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1217/2443] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:50:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:52:10.132580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eeafb-bab3-41f8-9720-f671fc9e1218 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:52:10.205668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eeafb-bab3-41f8-9720-f671fc9e1218 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:52:10.211473 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2979a-f26b-41fd-9a80-6f1954571fde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:52:10.212169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2979a-f26b-41fd-9a80-6f1954571fde service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:52:10.212466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2979a-f26b-41fd-9a80-6f1954571fde service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:52:10.212743 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2979a-f26b-41fd-9a80-6f1954571fde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:52:10.224225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2979a-f26b-41fd-9a80-6f1954571fde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:52:10.226543 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2979a-f26b-41fd-9a80-6f1954571fde service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:52:10.240816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1227/2444] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:53:26.731998 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b42145-1ad9-4698-9855-41627ee6106e service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:53:26.752762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b42145-1ad9-4698-9855-41627ee6106e service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:53:26.756490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb746f-fc68-4275-9ca5-db05c74c588a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:53:26.757136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb746f-fc68-4275-9ca5-db05c74c588a service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:53:26.757461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb746f-fc68-4275-9ca5-db05c74c588a service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:53:26.757735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb746f-fc68-4275-9ca5-db05c74c588a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:53:26.770599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb746f-fc68-4275-9ca5-db05c74c588a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:53:26.772098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb746f-fc68-4275-9ca5-db05c74c588a service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:53:26.799004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1218/2445] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:53:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:53:26.907550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2979a-f26b-41fd-9a80-6f1954571fde service placement] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:53:26.919414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2979a-f26b-41fd-9a80-6f1954571fde service placement] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:53:26.923588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3217c-c750-4adc-875c-ca6eea69ad01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:53:26.924357 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3217c-c750-4adc-875c-ca6eea69ad01 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:53:26.924618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3217c-c750-4adc-875c-ca6eea69ad01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:53:26.925042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3217c-c750-4adc-875c-ca6eea69ad01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:53:26.937032 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3217c-c750-4adc-875c-ca6eea69ad01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:53:26.938520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3217c-c750-4adc-875c-ca6eea69ad01 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:53:26.950616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1228/2446] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:53:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:53:26.999940 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb746f-fc68-4275-9ca5-db05c74c588a service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:53:27.014449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb746f-fc68-4275-9ca5-db05c74c588a service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:53:27.024550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c33ac-07ee-414b-83f8-bb5a13ee666c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:53:27.024550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c33ac-07ee-414b-83f8-bb5a13ee666c service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:53:27.024550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c33ac-07ee-414b-83f8-bb5a13ee666c service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:53:27.029532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c33ac-07ee-414b-83f8-bb5a13ee666c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:53:27.042582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c33ac-07ee-414b-83f8-bb5a13ee666c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:53:27.053544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c33ac-07ee-414b-83f8-bb5a13ee666c service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:53:27.087326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1219/2447] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:53:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:54:13.822388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3217c-c750-4adc-875c-ca6eea69ad01 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:54:13.824972 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-56a3217c-c750-4adc-875c-ca6eea69ad01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:54:13.942689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3217c-c750-4adc-875c-ca6eea69ad01 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:54:13.948590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144661c5-ec38-4126-9734-92f961c613c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:54:13.949712 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144661c5-ec38-4126-9734-92f961c613c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:54:13.950468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144661c5-ec38-4126-9734-92f961c613c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:54:13.950468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144661c5-ec38-4126-9734-92f961c613c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:54:13.962432 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144661c5-ec38-4126-9734-92f961c613c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:54:13.965427 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144661c5-ec38-4126-9734-92f961c613c9 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:54:13.981220 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1229/2448] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:54:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:54:31.092510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c33ac-07ee-414b-83f8-bb5a13ee666c service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:54:31.094569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-028c33ac-07ee-414b-83f8-bb5a13ee666c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:54:31.175526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c33ac-07ee-414b-83f8-bb5a13ee666c service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:54:31.181203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e93f0-4c67-437d-8fa5-374c5ddddb48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:54:31.189774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e93f0-4c67-437d-8fa5-374c5ddddb48 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:54:31.189774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e93f0-4c67-437d-8fa5-374c5ddddb48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:54:31.189774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e93f0-4c67-437d-8fa5-374c5ddddb48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:54:31.189774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-330e93f0-4c67-437d-8fa5-374c5ddddb48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:54:31.289946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e93f0-4c67-437d-8fa5-374c5ddddb48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:54:31.292256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e93f0-4c67-437d-8fa5-374c5ddddb48 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:54:31.305656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1220/2449] 10.222.0.59 () {60 vars in 1396 bytes} [Thu May 12 20:54:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:54:31.405349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144661c5-ec38-4126-9734-92f961c613c9 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:54:31.421562 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144661c5-ec38-4126-9734-92f961c613c9 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:54:31.427159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f045d3f-9818-432b-a964-c45218901691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:54:31.427913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f045d3f-9818-432b-a964-c45218901691 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:54:31.428266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f045d3f-9818-432b-a964-c45218901691 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:54:31.428560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f045d3f-9818-432b-a964-c45218901691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:54:31.431268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3f045d3f-9818-432b-a964-c45218901691 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:54:31.545056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f045d3f-9818-432b-a964-c45218901691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:54:31.632483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f045d3f-9818-432b-a964-c45218901691 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:54:31.632483 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1230/2450] 10.222.0.59 () {60 vars in 1396 bytes} [Thu May 12 20:54:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:54:31.639735 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e93f0-4c67-437d-8fa5-374c5ddddb48 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:54:31.652842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e93f0-4c67-437d-8fa5-374c5ddddb48 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:54:31.659045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6be62-4ab6-4d4b-a49e-7a9a9855f65b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:54:31.660322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6be62-4ab6-4d4b-a49e-7a9a9855f65b service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:54:31.660682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6be62-4ab6-4d4b-a49e-7a9a9855f65b service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:54:31.661414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6be62-4ab6-4d4b-a49e-7a9a9855f65b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:54:31.673797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6be62-4ab6-4d4b-a49e-7a9a9855f65b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:54:31.675390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6be62-4ab6-4d4b-a49e-7a9a9855f65b service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:54:31.689152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1221/2451] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:55:27.399352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f045d3f-9818-432b-a964-c45218901691 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:55:27.415741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f045d3f-9818-432b-a964-c45218901691 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:55:27.431454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f08e6-dfa6-415b-b9b5-b065ad0e2b33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:55:27.432302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f08e6-dfa6-415b-b9b5-b065ad0e2b33 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:55:27.432645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f08e6-dfa6-415b-b9b5-b065ad0e2b33 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:55:27.433000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f08e6-dfa6-415b-b9b5-b065ad0e2b33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:55:27.443476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f08e6-dfa6-415b-b9b5-b065ad0e2b33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:55:27.446196 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f08e6-dfa6-415b-b9b5-b065ad0e2b33 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:55:27.457493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1231/2452] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:55:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:56:32.806959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6be62-4ab6-4d4b-a49e-7a9a9855f65b service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:56:32.823714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6be62-4ab6-4d4b-a49e-7a9a9855f65b service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:56:32.834937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9556182-6479-4743-bdf3-90450382dee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:56:32.835651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9556182-6479-4743-bdf3-90450382dee6 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:56:32.835942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9556182-6479-4743-bdf3-90450382dee6 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:56:32.836332 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9556182-6479-4743-bdf3-90450382dee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:56:32.852472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9556182-6479-4743-bdf3-90450382dee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:56:32.854181 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9556182-6479-4743-bdf3-90450382dee6 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:56:32.868608 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1222/2453] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:56:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:57:14.086448 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f08e6-dfa6-415b-b9b5-b065ad0e2b33 service nova] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:57:14.087861 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2b5f08e6-dfa6-415b-b9b5-b065ad0e2b33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:57:14.170929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f08e6-dfa6-415b-b9b5-b065ad0e2b33 service nova] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:57:14.175835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1271a8-e66f-4b50-8bc1-039865ea0dde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:57:14.176484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1271a8-e66f-4b50-8bc1-039865ea0dde service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:57:14.176764 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1271a8-e66f-4b50-8bc1-039865ea0dde service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:57:14.177042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1271a8-e66f-4b50-8bc1-039865ea0dde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:57:14.179322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bc1271a8-e66f-4b50-8bc1-039865ea0dde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:57:14.190809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1271a8-e66f-4b50-8bc1-039865ea0dde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:57:14.192394 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1271a8-e66f-4b50-8bc1-039865ea0dde service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:57:14.203491 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1232/2454] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:57:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:58:20.228099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9556182-6479-4743-bdf3-90450382dee6 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:58:20.241532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9556182-6479-4743-bdf3-90450382dee6 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:58:20.246649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbcc92-a342-4de5-9f27-ad78d462b7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:58:20.247382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbcc92-a342-4de5-9f27-ad78d462b7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:58:20.247852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbcc92-a342-4de5-9f27-ad78d462b7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:58:20.248287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbcc92-a342-4de5-9f27-ad78d462b7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:58:20.251368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-37bbcc92-a342-4de5-9f27-ad78d462b7e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:58:20.343678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbcc92-a342-4de5-9f27-ad78d462b7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:58:20.345428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbcc92-a342-4de5-9f27-ad78d462b7e9 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:58:20.366400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1223/2455] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 20:58:28.046384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1271a8-e66f-4b50-8bc1-039865ea0dde service placement] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:58:28.048633 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bc1271a8-e66f-4b50-8bc1-039865ea0dde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:58:28.065501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1271a8-e66f-4b50-8bc1-039865ea0dde service placement] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:58:28.070113 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:58:28.070985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:58:28.071271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:58:28.071551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] PATH_INFO: `/v3/users/565a25c59df84a1fa6f6420093e89fb4` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:58:28.085267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565a25c59df84a1fa6f6420093e89fb4)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:58:28.087299 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:58:28.250217 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565a25c59df84a1fa6f6420093e89fb4'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:28.251363 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565a25c59df84a1fa6f6420093e89fb4'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:28.251980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565a25c59df84a1fa6f6420093e89fb4'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:28.263870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565a25c59df84a1fa6f6420093e89fb4'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:28.271072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565a25c59df84a1fa6f6420093e89fb4'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:28.330721 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1233/2456] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:58:28 2022] DELETE /identity/v3/users/565a25c59df84a1fa6f6420093e89fb4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:58:28.561179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbcc92-a342-4de5-9f27-ad78d462b7e9 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:58:28.573021 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbcc92-a342-4de5-9f27-ad78d462b7e9 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:58:28.639095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:58:28.639969 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:58:28.640255 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:58:28.640534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] PATH_INFO: `/v3/projects/3d9b727e705940c5bbdad32f9cb69087` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:58:28.641848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9b727e705940c5bbdad32f9cb69087)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:58:28.643818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:58:28.737064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9b727e705940c5bbdad32f9cb69087', 'request_id': 'req-0b209ede-d3e5-4928-803f-027b819e88fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:28.742357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9b727e705940c5bbdad32f9cb69087', 'request_id': 'req-0b209ede-d3e5-4928-803f-027b819e88fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:28.784116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9b727e705940c5bbdad32f9cb69087', 'request_id': 'req-0b209ede-d3e5-4928-803f-027b819e88fc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:28.795134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] The token cache is being invalidate because project 3d9b727e705940c5bbdad32f9cb69087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:58:28.795447 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:28.796066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:28.798065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1224/2457] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:58:28 2022] DELETE /identity/v3/projects/3d9b727e705940c5bbdad32f9cb69087 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:58:28.802323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:58:28.803744 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:58:28.816905 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d4ba2-4455-4f8b-a8e4-5445cb33a4d7 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:58:28.873645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:58:28.874543 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:58:28.874833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:58:28.875117 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] PATH_INFO: `/v3/users/827d3c3570344412913fbdc764a7ce8e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:58:28.893410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827d3c3570344412913fbdc764a7ce8e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:58:28.895757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:58:29.071073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827d3c3570344412913fbdc764a7ce8e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:29.071726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827d3c3570344412913fbdc764a7ce8e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:29.072221 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827d3c3570344412913fbdc764a7ce8e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:29.084963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827d3c3570344412913fbdc764a7ce8e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:29.091463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827d3c3570344412913fbdc764a7ce8e'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:29.137655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1234/2458] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 20:58:28 2022] DELETE /identity/v3/users/827d3c3570344412913fbdc764a7ce8e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:58:29.413027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:58:29.414570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:58:29.428271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209ede-d3e5-4928-803f-027b819e88fc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:58:29.485627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:58:29.486483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:58:29.486767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:58:29.487047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] PATH_INFO: `/v3/projects/0ff9aa29235548bf84f2f9fa243f52c7` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:58:29.497142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff9aa29235548bf84f2f9fa243f52c7)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:58:29.499081 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:58:29.615180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff9aa29235548bf84f2f9fa243f52c7', 'request_id': 'req-aff827d8-c101-49be-96b3-fb5207bf7d70'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:29.623495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff9aa29235548bf84f2f9fa243f52c7', 'request_id': 'req-aff827d8-c101-49be-96b3-fb5207bf7d70'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:29.702871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff9aa29235548bf84f2f9fa243f52c7', 'request_id': 'req-aff827d8-c101-49be-96b3-fb5207bf7d70'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:29.715347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] The token cache is being invalidate because project 0ff9aa29235548bf84f2f9fa243f52c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 20:58:29.717692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:29.717692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 20:58:29.717917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1225/2459] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 20:58:29 2022] DELETE /identity/v3/projects/0ff9aa29235548bf84f2f9fa243f52c7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 20:58:33.511260 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:58:33.512691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:58:33.569105 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bb816-8701-42de-ae15-3662efb5c075 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:58:33.616233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c13558-0841-4e2d-a5dc-16100f0a7318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:58:33.616893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13558-0841-4e2d-a5dc-16100f0a7318 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:58:33.617181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13558-0841-4e2d-a5dc-16100f0a7318 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:58:33.617493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13558-0841-4e2d-a5dc-16100f0a7318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:58:33.619293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-08c13558-0841-4e2d-a5dc-16100f0a7318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application [None req-08c13558-0841-4e2d-a5dc-16100f0a7318 service cinder] Could not find project: 3d9b727e705940c5bbdad32f9cb69087.: keystone.exception.ProjectNotFound: Could not find project: 3d9b727e705940c5bbdad32f9cb69087. May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 12 20:58:33.663156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:58:33.664591 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self._validate_token_resources() May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 20:58:33.665991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.get_or_create( May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application with Lock( May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._enter() May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.creator() May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application created_value = creator( May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 20:58:33.667300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 20:58:33.668574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3d9b727e705940c5bbdad32f9cb69087. May 12 20:58:33.668574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: ERROR keystone.server.flask.application May 12 20:58:33.668574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1235/2460] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:58:33 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 12 20:59:20.836496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:59:20.838007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:59:20.896322 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff827d8-c101-49be-96b3-fb5207bf7d70 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:59:20.900240 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b64d54-db96-4c43-980c-7550f18d538a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:59:20.900898 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b64d54-db96-4c43-980c-7550f18d538a service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:59:20.901187 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b64d54-db96-4c43-980c-7550f18d538a service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:59:20.901503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b64d54-db96-4c43-980c-7550f18d538a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:59:20.903297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-39b64d54-db96-4c43-980c-7550f18d538a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:59:20.912927 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b64d54-db96-4c43-980c-7550f18d538a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:59:20.914393 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b64d54-db96-4c43-980c-7550f18d538a service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:59:20.931374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1226/2461] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:59:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:59:30.369027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c13558-0841-4e2d-a5dc-16100f0a7318 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:59:30.370511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-08c13558-0841-4e2d-a5dc-16100f0a7318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:59:30.381696 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c13558-0841-4e2d-a5dc-16100f0a7318 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:59:30.385643 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccbf2d-d357-4898-9f7a-f601b9874484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:59:30.386280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccbf2d-d357-4898-9f7a-f601b9874484 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:59:30.386563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccbf2d-d357-4898-9f7a-f601b9874484 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:59:30.386835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccbf2d-d357-4898-9f7a-f601b9874484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:59:30.388545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1eccbf2d-d357-4898-9f7a-f601b9874484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:59:30.454747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccbf2d-d357-4898-9f7a-f601b9874484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:59:30.456055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccbf2d-d357-4898-9f7a-f601b9874484 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:59:30.465713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1236/2462] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:59:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:59:30.513903 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b64d54-db96-4c43-980c-7550f18d538a service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:59:30.524064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b64d54-db96-4c43-980c-7550f18d538a service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:59:30.527633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04f02e-acc2-4e96-ae8c-cb3da8a33ae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:59:30.528299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04f02e-acc2-4e96-ae8c-cb3da8a33ae4 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:59:30.528586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04f02e-acc2-4e96-ae8c-cb3da8a33ae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:59:30.528862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04f02e-acc2-4e96-ae8c-cb3da8a33ae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:59:30.530656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-be04f02e-acc2-4e96-ae8c-cb3da8a33ae4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:59:30.617372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04f02e-acc2-4e96-ae8c-cb3da8a33ae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:59:30.618717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04f02e-acc2-4e96-ae8c-cb3da8a33ae4 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:59:30.637938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1227/2463] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:59:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 20:59:30.669995 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccbf2d-d357-4898-9f7a-f601b9874484 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 20:59:30.671421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1eccbf2d-d357-4898-9f7a-f601b9874484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:59:30.755685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccbf2d-d357-4898-9f7a-f601b9874484 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 20:59:30.761516 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23be3ca-5120-498b-bfa0-0c7ac6ab2ffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 20:59:30.762205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23be3ca-5120-498b-bfa0-0c7ac6ab2ffa service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 20:59:30.762495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23be3ca-5120-498b-bfa0-0c7ac6ab2ffa service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 20:59:30.762779 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23be3ca-5120-498b-bfa0-0c7ac6ab2ffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 20:59:30.764583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d23be3ca-5120-498b-bfa0-0c7ac6ab2ffa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 20:59:30.830606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23be3ca-5120-498b-bfa0-0c7ac6ab2ffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 20:59:30.832218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23be3ca-5120-498b-bfa0-0c7ac6ab2ffa service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 20:59:30.850156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1237/2464] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 20:59:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:00:27.687815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04f02e-acc2-4e96-ae8c-cb3da8a33ae4 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:00:27.696420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04f02e-acc2-4e96-ae8c-cb3da8a33ae4 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:00:27.700117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947ccf-dd00-46b0-a74c-5f51751ab9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:00:27.700765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947ccf-dd00-46b0-a74c-5f51751ab9ca service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:00:27.701052 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947ccf-dd00-46b0-a74c-5f51751ab9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:00:27.701371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947ccf-dd00-46b0-a74c-5f51751ab9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:00:27.703303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-97947ccf-dd00-46b0-a74c-5f51751ab9ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:00:27.783527 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97947ccf-dd00-46b0-a74c-5f51751ab9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:00:27.784954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97947ccf-dd00-46b0-a74c-5f51751ab9ca service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:00:27.803904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1228/2465] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:00:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:02:20.045159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23be3ca-5120-498b-bfa0-0c7ac6ab2ffa service nova] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:20.046704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d23be3ca-5120-498b-bfa0-0c7ac6ab2ffa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:20.172579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23be3ca-5120-498b-bfa0-0c7ac6ab2ffa service nova] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:20.177544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ffc3-3850-4bcb-9831-c4bdfc80bfa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:20.178186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ffc3-3850-4bcb-9831-c4bdfc80bfa7 service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:20.178468 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ffc3-3850-4bcb-9831-c4bdfc80bfa7 service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:20.178743 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879ffc3-3850-4bcb-9831-c4bdfc80bfa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:20.180497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0879ffc3-3850-4bcb-9831-c4bdfc80bfa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:20.193419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879ffc3-3850-4bcb-9831-c4bdfc80bfa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:20.195028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879ffc3-3850-4bcb-9831-c4bdfc80bfa7 service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:20.206228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1238/2466] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:02:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:02:33.153098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947ccf-dd00-46b0-a74c-5f51751ab9ca service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:33.154535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-97947ccf-dd00-46b0-a74c-5f51751ab9ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:33.186313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947ccf-dd00-46b0-a74c-5f51751ab9ca service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:33.189920 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a2bd7-1117-4a70-a6cc-3cfd4761b14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:33.190546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2bd7-1117-4a70-a6cc-3cfd4761b14d service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:33.190828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2bd7-1117-4a70-a6cc-3cfd4761b14d service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:33.191105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2bd7-1117-4a70-a6cc-3cfd4761b14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:33.192853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-214a2bd7-1117-4a70-a6cc-3cfd4761b14d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:33.260755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a2bd7-1117-4a70-a6cc-3cfd4761b14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:33.262229 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a2bd7-1117-4a70-a6cc-3cfd4761b14d service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:33.274372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1229/2467] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:02:34.608320 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ffc3-3850-4bcb-9831-c4bdfc80bfa7 service placement] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:34.622556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879ffc3-3850-4bcb-9831-c4bdfc80bfa7 service placement] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:34.628741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1849556-20a4-4b4d-b48c-9989de97e967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:34.629587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849556-20a4-4b4d-b48c-9989de97e967 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:34.629885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849556-20a4-4b4d-b48c-9989de97e967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:34.630314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1849556-20a4-4b4d-b48c-9989de97e967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:34.632264 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f1849556-20a4-4b4d-b48c-9989de97e967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:34.659159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1849556-20a4-4b4d-b48c-9989de97e967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:34.660585 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1849556-20a4-4b4d-b48c-9989de97e967 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:34.676323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1239/2468] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:02:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:02:37.516225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a2bd7-1117-4a70-a6cc-3cfd4761b14d service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:37.530847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-214a2bd7-1117-4a70-a6cc-3cfd4761b14d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:37.538090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a2bd7-1117-4a70-a6cc-3cfd4761b14d service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:37.545089 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:37.546046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:37.546338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:37.546623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] PATH_INFO: `/v3/users/64ce721d7163430dbf31ffbbf28c2094` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:37.547928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ce721d7163430dbf31ffbbf28c2094)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:37.550288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:37.824565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ce721d7163430dbf31ffbbf28c2094'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:02:37.836311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ce721d7163430dbf31ffbbf28c2094'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:02:37.837167 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ce721d7163430dbf31ffbbf28c2094'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:02:37.930108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ce721d7163430dbf31ffbbf28c2094'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:02:37.937672 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-301d4f8f-1b07-4241-bfb4-f93dd9621018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ce721d7163430dbf31ffbbf28c2094'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:02:37.943770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1230/2469] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:02:37 2022] DELETE /identity/v3/users/64ce721d7163430dbf31ffbbf28c2094 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:02:38.215670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1849556-20a4-4b4d-b48c-9989de97e967 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:38.227624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1849556-20a4-4b4d-b48c-9989de97e967 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:38.298998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:38.299884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:38.300170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:38.300447 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] PATH_INFO: `/v3/projects/e3bcc803e53f46efb996577417eca77a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:38.301708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bcc803e53f46efb996577417eca77a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:38.303631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:38.422095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bcc803e53f46efb996577417eca77a', 'request_id': 'req-711ecadf-59d5-42e0-a12a-b948bf91bb44'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:02:38.427257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bcc803e53f46efb996577417eca77a', 'request_id': 'req-711ecadf-59d5-42e0-a12a-b948bf91bb44'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:02:38.518922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bcc803e53f46efb996577417eca77a', 'request_id': 'req-711ecadf-59d5-42e0-a12a-b948bf91bb44'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:02:38.531575 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] The token cache is being invalidate because project e3bcc803e53f46efb996577417eca77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:02:38.539254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:02:38.539254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-711ecadf-59d5-42e0-a12a-b948bf91bb44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:02:38.539254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1240/2470] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:02:38 2022] DELETE /identity/v3/projects/e3bcc803e53f46efb996577417eca77a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:02:38.539786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097a68-6527-4306-8f93-3ae4fd45aae6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:38.540238 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097a68-6527-4306-8f93-3ae4fd45aae6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:38.540335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097a68-6527-4306-8f93-3ae4fd45aae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:38.597915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c8097a68-6527-4306-8f93-3ae4fd45aae6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:02:38.599154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c8097a68-6527-4306-8f93-3ae4fd45aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:38.658289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1231/2471] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:02:38.666232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44c5d5-3f34-41ab-870e-fc83ae09f04d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:38.666609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44c5d5-3f34-41ab-870e-fc83ae09f04d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:38.667228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44c5d5-3f34-41ab-870e-fc83ae09f04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:38.685528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-3b44c5d5-3f34-41ab-870e-fc83ae09f04d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:02:38.686733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3b44c5d5-3f34-41ab-870e-fc83ae09f04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:38.694617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1241/2472] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:02:38.699395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097a68-6527-4306-8f93-3ae4fd45aae6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:38.710043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097a68-6527-4306-8f93-3ae4fd45aae6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:38.715496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ae9b2-ce56-422c-886c-f4acd0163c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:38.716155 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ae9b2-ce56-422c-886c-f4acd0163c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:38.716442 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ae9b2-ce56-422c-886c-f4acd0163c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:38.716775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ae9b2-ce56-422c-886c-f4acd0163c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:38.717489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ae9b2-ce56-422c-886c-f4acd0163c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:02:38.717802 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ae9b2-ce56-422c-886c-f4acd0163c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:38.719463 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ae9b2-ce56-422c-886c-f4acd0163c84 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:38.731739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1232/2473] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:02:38.736325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44c5d5-3f34-41ab-870e-fc83ae09f04d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:38.746553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44c5d5-3f34-41ab-870e-fc83ae09f04d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:38.752102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac4765-add2-4bb3-b92c-f42535ad6e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:38.752773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac4765-add2-4bb3-b92c-f42535ad6e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:38.753060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac4765-add2-4bb3-b92c-f42535ad6e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:38.753376 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac4765-add2-4bb3-b92c-f42535ad6e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:38.754137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac4765-add2-4bb3-b92c-f42535ad6e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:38.756059 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac4765-add2-4bb3-b92c-f42535ad6e9e admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:38.860708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1242/2474] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:02:38 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:02:38.865501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ae9b2-ce56-422c-886c-f4acd0163c84 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:38.876582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ae9b2-ce56-422c-886c-f4acd0163c84 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:38.935138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560a31d-a847-40d9-aa93-aaf3230dd348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:38.935825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a31d-a847-40d9-aa93-aaf3230dd348 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:38.936113 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a31d-a847-40d9-aa93-aaf3230dd348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:38.936395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560a31d-a847-40d9-aa93-aaf3230dd348 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:38.937108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560a31d-a847-40d9-aa93-aaf3230dd348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:38.939059 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560a31d-a847-40d9-aa93-aaf3230dd348 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:39.074865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1233/2475] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:02:38 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:02:39.079986 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac4765-add2-4bb3-b92c-f42535ad6e9e admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:39.091526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac4765-add2-4bb3-b92c-f42535ad6e9e admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:39.096196 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85441223-6e53-4a84-8035-45868a52eaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:39.096858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85441223-6e53-4a84-8035-45868a52eaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:39.097138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85441223-6e53-4a84-8035-45868a52eaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:39.097458 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85441223-6e53-4a84-8035-45868a52eaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:39.098187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85441223-6e53-4a84-8035-45868a52eaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:39.099784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85441223-6e53-4a84-8035-45868a52eaa7 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:39.110454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1243/2476] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:02:39.114559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560a31d-a847-40d9-aa93-aaf3230dd348 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:39.125427 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560a31d-a847-40d9-aa93-aaf3230dd348 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:39.130349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c73c2-3d59-449e-8e34-1a2bddee50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:39.131146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c73c2-3d59-449e-8e34-1a2bddee50eb admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:39.131485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c73c2-3d59-449e-8e34-1a2bddee50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:39.131760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c73c2-3d59-449e-8e34-1a2bddee50eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:39.132528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c73c2-3d59-449e-8e34-1a2bddee50eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:39.134197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c73c2-3d59-449e-8e34-1a2bddee50eb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:39.146109 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1234/2477] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:02:39.150352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85441223-6e53-4a84-8035-45868a52eaa7 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:39.160773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85441223-6e53-4a84-8035-45868a52eaa7 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:39.165362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30491172-e24d-4e02-bb93-226fc537809a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:39.166305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30491172-e24d-4e02-bb93-226fc537809a admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:39.167145 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30491172-e24d-4e02-bb93-226fc537809a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:39.167487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30491172-e24d-4e02-bb93-226fc537809a admin admin] PATH_INFO: `/v3/projects/aba1b049f3e54c4da6e54c994722399e/users/ecbae1d4dc5842488f4bcbc4a6ed55ee/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:39.184118 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30491172-e24d-4e02-bb93-226fc537809a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba1b049f3e54c4da6e54c994722399e, user_id=ecbae1d4dc5842488f4bcbc4a6ed55ee, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:39.186814 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30491172-e24d-4e02-bb93-226fc537809a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:39.268235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1244/2478] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:02:39 2022] PUT /identity/v3/projects/aba1b049f3e54c4da6e54c994722399e/users/ecbae1d4dc5842488f4bcbc4a6ed55ee/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:02:39.278554 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac517-3d71-4bbd-b910-6855ef82f8e4 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:39.278851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac517-3d71-4bbd-b910-6855ef82f8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:39.291237 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac517-3d71-4bbd-b910-6855ef82f8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:39.306365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4e0ac517-3d71-4bbd-b910-6855ef82f8e4 None None] MFA Rules not processed for user `ecbae1d4dc5842488f4bcbc4a6ed55ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:02:39.308203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4e0ac517-3d71-4bbd-b910-6855ef82f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:39.374257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1235/2479] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:02:39.379243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30491172-e24d-4e02-bb93-226fc537809a admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:39.448449 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30491172-e24d-4e02-bb93-226fc537809a admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:39.453185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f12d17-1e86-4190-a8a0-db6cde4ddad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:39.453899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12d17-1e86-4190-a8a0-db6cde4ddad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:39.454313 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12d17-1e86-4190-a8a0-db6cde4ddad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:39.454486 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f12d17-1e86-4190-a8a0-db6cde4ddad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:39.455170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f12d17-1e86-4190-a8a0-db6cde4ddad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:39.457081 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f12d17-1e86-4190-a8a0-db6cde4ddad1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:39.556825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1245/2480] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:02:39 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:02:39.562118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac517-3d71-4bbd-b910-6855ef82f8e4 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:39.574182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac517-3d71-4bbd-b910-6855ef82f8e4 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:39.631831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9023b03-5a7a-4335-b0dd-5693546322d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:39.632429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9023b03-5a7a-4335-b0dd-5693546322d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:39.632719 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9023b03-5a7a-4335-b0dd-5693546322d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:39.633253 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9023b03-5a7a-4335-b0dd-5693546322d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:39.633761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9023b03-5a7a-4335-b0dd-5693546322d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:39.636738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9023b03-5a7a-4335-b0dd-5693546322d3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:39.750977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1236/2481] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:02:39 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:02:39.755045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f12d17-1e86-4190-a8a0-db6cde4ddad1 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:39.768279 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f12d17-1e86-4190-a8a0-db6cde4ddad1 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:39.773043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7ff56-bee5-4112-82ae-f7e87392fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:39.773863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7ff56-bee5-4112-82ae-f7e87392fee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:39.774150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7ff56-bee5-4112-82ae-f7e87392fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:39.774428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7ff56-bee5-4112-82ae-f7e87392fee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:39.775163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7ff56-bee5-4112-82ae-f7e87392fee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:39.776877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7ff56-bee5-4112-82ae-f7e87392fee2 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:39.787783 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1246/2482] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:02:39.792078 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9023b03-5a7a-4335-b0dd-5693546322d3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:39.802804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9023b03-5a7a-4335-b0dd-5693546322d3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:39.808406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14e42-db2c-43dd-a11e-fc2808e61b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:39.809339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14e42-db2c-43dd-a11e-fc2808e61b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:39.809691 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14e42-db2c-43dd-a11e-fc2808e61b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:39.809885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14e42-db2c-43dd-a11e-fc2808e61b55 admin admin] PATH_INFO: `/v3/projects/62b5b8e89e51493e8cc0b5dd73435b48/users/2e600815021c4186817c4d9ffe02d03d/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:39.826186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e14e42-db2c-43dd-a11e-fc2808e61b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b5b8e89e51493e8cc0b5dd73435b48, user_id=2e600815021c4186817c4d9ffe02d03d, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:39.829158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e14e42-db2c-43dd-a11e-fc2808e61b55 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:39.925139 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1237/2483] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:02:39 2022] PUT /identity/v3/projects/62b5b8e89e51493e8cc0b5dd73435b48/users/2e600815021c4186817c4d9ffe02d03d/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:02:39.929215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7ff56-bee5-4112-82ae-f7e87392fee2 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:39.942085 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7ff56-bee5-4112-82ae-f7e87392fee2 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:40.000349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d806a-cd8c-43db-8c21-8046ddc9430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:40.001469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d806a-cd8c-43db-8c21-8046ddc9430c admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:40.001469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d806a-cd8c-43db-8c21-8046ddc9430c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:40.001864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d806a-cd8c-43db-8c21-8046ddc9430c admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:40.002780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d806a-cd8c-43db-8c21-8046ddc9430c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:40.004401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d806a-cd8c-43db-8c21-8046ddc9430c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:40.019460 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1247/2484] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:02:40.020659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14e42-db2c-43dd-a11e-fc2808e61b55 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:40.032318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14e42-db2c-43dd-a11e-fc2808e61b55 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:40.037056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2fa9-6f52-40d2-9b56-8bfcb0109fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:40.037993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2fa9-6f52-40d2-9b56-8bfcb0109fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:40.038280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2fa9-6f52-40d2-9b56-8bfcb0109fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:40.038559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2fa9-6f52-40d2-9b56-8bfcb0109fb3 admin admin] PATH_INFO: `/v3/projects/62b5b8e89e51493e8cc0b5dd73435b48/users/2e600815021c4186817c4d9ffe02d03d/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:40.040533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde2fa9-6f52-40d2-9b56-8bfcb0109fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b5b8e89e51493e8cc0b5dd73435b48, user_id=2e600815021c4186817c4d9ffe02d03d, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:40.043360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde2fa9-6f52-40d2-9b56-8bfcb0109fb3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:40.056086 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1238/2485] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:02:40 2022] PUT /identity/v3/projects/62b5b8e89e51493e8cc0b5dd73435b48/users/2e600815021c4186817c4d9ffe02d03d/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:02:40.068170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdea697-3f37-41b7-8647-70ad68cfe362 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:40.068465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdea697-3f37-41b7-8647-70ad68cfe362 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:40.068750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdea697-3f37-41b7-8647-70ad68cfe362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:40.097395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5bdea697-3f37-41b7-8647-70ad68cfe362 None None] MFA Rules not processed for user `2e600815021c4186817c4d9ffe02d03d`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:02:40.109615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5bdea697-3f37-41b7-8647-70ad68cfe362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:40.165482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1248/2486] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:02:40.176715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2fa9-6f52-40d2-9b56-8bfcb0109fb3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:40.178505 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6dde2fa9-6f52-40d2-9b56-8bfcb0109fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:02:40.237511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2fa9-6f52-40d2-9b56-8bfcb0109fb3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:40.241105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8d09f-c174-49dc-b126-7cfacd227a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:40.241776 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8d09f-c174-49dc-b126-7cfacd227a89 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:40.242060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8d09f-c174-49dc-b126-7cfacd227a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:40.242335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8d09f-c174-49dc-b126-7cfacd227a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:40.252360 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8d09f-c174-49dc-b126-7cfacd227a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:40.253879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8d09f-c174-49dc-b126-7cfacd227a89 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:40.264755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1239/2487] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:02:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:02:40.533838 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdea697-3f37-41b7-8647-70ad68cfe362 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:02:40.547365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdea697-3f37-41b7-8647-70ad68cfe362 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:02:40.551015 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56db537-0491-48f9-9a3e-a52bf9a1a1cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:02:40.551738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56db537-0491-48f9-9a3e-a52bf9a1a1cf service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:02:40.552024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56db537-0491-48f9-9a3e-a52bf9a1a1cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:02:40.552306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56db537-0491-48f9-9a3e-a52bf9a1a1cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:02:40.616482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56db537-0491-48f9-9a3e-a52bf9a1a1cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:02:40.618014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56db537-0491-48f9-9a3e-a52bf9a1a1cf service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:02:40.629131 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1249/2488] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:02:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:03:29.274450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8d09f-c174-49dc-b126-7cfacd227a89 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:03:29.275949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-baf8d09f-c174-49dc-b126-7cfacd227a89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:03:29.331803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8d09f-c174-49dc-b126-7cfacd227a89 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:03:29.335534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666fa73-2899-419f-b0b5-7f16835858ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:03:29.336177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666fa73-2899-419f-b0b5-7f16835858ee service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:03:29.336462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666fa73-2899-419f-b0b5-7f16835858ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:03:29.336739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666fa73-2899-419f-b0b5-7f16835858ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:03:29.338570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b666fa73-2899-419f-b0b5-7f16835858ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:03:29.408997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666fa73-2899-419f-b0b5-7f16835858ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:03:29.410518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666fa73-2899-419f-b0b5-7f16835858ee service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:03:29.432205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1240/2489] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:03:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:04:21.816705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56db537-0491-48f9-9a3e-a52bf9a1a1cf service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:04:21.836244 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56db537-0491-48f9-9a3e-a52bf9a1a1cf service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:04:21.840693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1766d4-dc13-4d65-ad85-98d0ad5f1459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:04:21.841373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1766d4-dc13-4d65-ad85-98d0ad5f1459 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:04:21.841705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1766d4-dc13-4d65-ad85-98d0ad5f1459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:04:21.841989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1766d4-dc13-4d65-ad85-98d0ad5f1459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:04:21.843800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0a1766d4-dc13-4d65-ad85-98d0ad5f1459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:04:21.869194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1766d4-dc13-4d65-ad85-98d0ad5f1459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:04:21.870824 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1766d4-dc13-4d65-ad85-98d0ad5f1459 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:04:21.878898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1250/2490] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:04:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:04:30.543034 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666fa73-2899-419f-b0b5-7f16835858ee service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:04:30.561982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666fa73-2899-419f-b0b5-7f16835858ee service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:04:30.565698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d3fe-6315-4626-9cbc-d44dbfd74188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:04:30.566339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d3fe-6315-4626-9cbc-d44dbfd74188 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:04:30.566624 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d3fe-6315-4626-9cbc-d44dbfd74188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:04:30.566902 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d3fe-6315-4626-9cbc-d44dbfd74188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:04:30.568660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4bd2d3fe-6315-4626-9cbc-d44dbfd74188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:04:30.625027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2d3fe-6315-4626-9cbc-d44dbfd74188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:04:30.626497 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2d3fe-6315-4626-9cbc-d44dbfd74188 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:04:30.635189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1241/2491] 10.222.0.59 () {60 vars in 1396 bytes} [Thu May 12 21:04:30 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:04:31.049700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1766d4-dc13-4d65-ad85-98d0ad5f1459 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:04:31.051161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0a1766d4-dc13-4d65-ad85-98d0ad5f1459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:04:31.072646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1766d4-dc13-4d65-ad85-98d0ad5f1459 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:04:31.077336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d0865-49f3-44b1-b741-adfb0f91fbc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:04:31.077996 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d0865-49f3-44b1-b741-adfb0f91fbc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:04:31.078286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d0865-49f3-44b1-b741-adfb0f91fbc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:04:31.078570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d0865-49f3-44b1-b741-adfb0f91fbc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:04:31.080379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1d9d0865-49f3-44b1-b741-adfb0f91fbc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:04:31.139460 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d0865-49f3-44b1-b741-adfb0f91fbc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:04:31.140908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d0865-49f3-44b1-b741-adfb0f91fbc1 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:04:31.150392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1251/2492] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:04:31.198578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d3fe-6315-4626-9cbc-d44dbfd74188 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:04:31.207733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d3fe-6315-4626-9cbc-d44dbfd74188 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:04:31.211374 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820351a0-e744-4fd5-8dc9-ac043ba96e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:04:31.212018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820351a0-e744-4fd5-8dc9-ac043ba96e12 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:04:31.212298 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820351a0-e744-4fd5-8dc9-ac043ba96e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:04:31.212576 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820351a0-e744-4fd5-8dc9-ac043ba96e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:04:31.214386 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-820351a0-e744-4fd5-8dc9-ac043ba96e12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:04:31.272985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820351a0-e744-4fd5-8dc9-ac043ba96e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:04:31.274379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820351a0-e744-4fd5-8dc9-ac043ba96e12 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:04:31.283751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1242/2493] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:07:27.059642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d0865-49f3-44b1-b741-adfb0f91fbc1 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:07:27.061016 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1d9d0865-49f3-44b1-b741-adfb0f91fbc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:07:27.142116 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d0865-49f3-44b1-b741-adfb0f91fbc1 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:07:27.148218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09627e-a905-41df-a425-57381ef8f6fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:07:27.148871 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09627e-a905-41df-a425-57381ef8f6fa service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:07:27.149156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09627e-a905-41df-a425-57381ef8f6fa service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:07:27.149465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09627e-a905-41df-a425-57381ef8f6fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:07:27.151328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ac09627e-a905-41df-a425-57381ef8f6fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:07:27.163272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09627e-a905-41df-a425-57381ef8f6fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:07:27.164870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09627e-a905-41df-a425-57381ef8f6fa service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:07:27.174695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1252/2494] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:07:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:07:29.635452 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820351a0-e744-4fd5-8dc9-ac043ba96e12 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:07:29.637218 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-820351a0-e744-4fd5-8dc9-ac043ba96e12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:07:29.654228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820351a0-e744-4fd5-8dc9-ac043ba96e12 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:07:29.660535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74de31-e6b1-4942-8d5c-973d755a12aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:07:29.661192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74de31-e6b1-4942-8d5c-973d755a12aa service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:07:29.661510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74de31-e6b1-4942-8d5c-973d755a12aa service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:07:29.661793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74de31-e6b1-4942-8d5c-973d755a12aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:07:29.663636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9a74de31-e6b1-4942-8d5c-973d755a12aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:07:29.676966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74de31-e6b1-4942-8d5c-973d755a12aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:07:29.678709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74de31-e6b1-4942-8d5c-973d755a12aa service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:07:29.689553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1243/2495] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:07:35.478479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09627e-a905-41df-a425-57381ef8f6fa service placement] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:07:35.480496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ac09627e-a905-41df-a425-57381ef8f6fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:07:35.491706 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09627e-a905-41df-a425-57381ef8f6fa service placement] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:07:35.495259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd25f24-0a0b-4882-a1d6-0c59477f0b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:07:35.495897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd25f24-0a0b-4882-a1d6-0c59477f0b5d service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:07:35.496183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd25f24-0a0b-4882-a1d6-0c59477f0b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:07:35.496464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd25f24-0a0b-4882-a1d6-0c59477f0b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:07:35.498211 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-fcd25f24-0a0b-4882-a1d6-0c59477f0b5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:07:35.513156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd25f24-0a0b-4882-a1d6-0c59477f0b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:07:35.514626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd25f24-0a0b-4882-a1d6-0c59477f0b5d service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:07:35.526364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1253/2496] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:07:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:08:29.344275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74de31-e6b1-4942-8d5c-973d755a12aa service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:08:29.353789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74de31-e6b1-4942-8d5c-973d755a12aa service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:08:29.357437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e7584-96ba-4efd-b2a7-705eec927ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:08:29.358090 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e7584-96ba-4efd-b2a7-705eec927ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:08:29.358411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e7584-96ba-4efd-b2a7-705eec927ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:08:29.358692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e7584-96ba-4efd-b2a7-705eec927ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:08:29.369631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e7584-96ba-4efd-b2a7-705eec927ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:08:29.371076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e7584-96ba-4efd-b2a7-705eec927ec4 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:08:29.382686 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1244/2497] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:08:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:09:28.883875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd25f24-0a0b-4882-a1d6-0c59477f0b5d service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:28.893538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd25f24-0a0b-4882-a1d6-0c59477f0b5d service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:28.897156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd3f69-31aa-4c0f-ab68-4b47a1437e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:28.897838 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd3f69-31aa-4c0f-ab68-4b47a1437e9e service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:28.898128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd3f69-31aa-4c0f-ab68-4b47a1437e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:28.898412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd3f69-31aa-4c0f-ab68-4b47a1437e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:28.906784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd3f69-31aa-4c0f-ab68-4b47a1437e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:28.908228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd3f69-31aa-4c0f-ab68-4b47a1437e9e service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:28.917084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1254/2498] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:09:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:09:29.269897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e7584-96ba-4efd-b2a7-705eec927ec4 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:29.279522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e7584-96ba-4efd-b2a7-705eec927ec4 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:29.284313 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce35f-d105-4f4a-8d08-f7b41c45a768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:29.294617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce35f-d105-4f4a-8d08-f7b41c45a768 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:29.294617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce35f-d105-4f4a-8d08-f7b41c45a768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:29.294617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce35f-d105-4f4a-8d08-f7b41c45a768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:29.294617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-586ce35f-d105-4f4a-8d08-f7b41c45a768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:09:29.333884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd3f69-31aa-4c0f-ab68-4b47a1437e9e service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:29.343834 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd3f69-31aa-4c0f-ab68-4b47a1437e9e service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:29.347893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b8b5b-7ad3-4a87-a75d-f70fce65c2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:29.348995 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b8b5b-7ad3-4a87-a75d-f70fce65c2ee service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:29.348995 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b8b5b-7ad3-4a87-a75d-f70fce65c2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:29.349266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b8b5b-7ad3-4a87-a75d-f70fce65c2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:29.361183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b8b5b-7ad3-4a87-a75d-f70fce65c2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:29.362672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b8b5b-7ad3-4a87-a75d-f70fce65c2ee service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:29.371464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1255/2499] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:09:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:09:29.378670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ce35f-d105-4f4a-8d08-f7b41c45a768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:29.380037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ce35f-d105-4f4a-8d08-f7b41c45a768 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:29.408933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1245/2500] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:09:31.147928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b8b5b-7ad3-4a87-a75d-f70fce65c2ee service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:31.162182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b8b5b-7ad3-4a87-a75d-f70fce65c2ee service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:31.168066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d97185-078d-43c0-a3b3-39c113ef4407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:31.169411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d97185-078d-43c0-a3b3-39c113ef4407 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:31.169720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d97185-078d-43c0-a3b3-39c113ef4407 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:31.170008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d97185-078d-43c0-a3b3-39c113ef4407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:31.178542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d97185-078d-43c0-a3b3-39c113ef4407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:31.180196 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d97185-078d-43c0-a3b3-39c113ef4407 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:31.213394 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1256/2501] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:09:33.258578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce35f-d105-4f4a-8d08-f7b41c45a768 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:33.259288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-586ce35f-d105-4f4a-8d08-f7b41c45a768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:09:33.272388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce35f-d105-4f4a-8d08-f7b41c45a768 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:33.277020 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:33.277993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:33.278363 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:33.278651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] PATH_INFO: `/v3/users/606b53c6f60d45cf9e2c3e5c6c9cde2e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:33.292733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=606b53c6f60d45cf9e2c3e5c6c9cde2e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:33.295513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:33.484689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606b53c6f60d45cf9e2c3e5c6c9cde2e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:09:33.496183 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606b53c6f60d45cf9e2c3e5c6c9cde2e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:09:33.497585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606b53c6f60d45cf9e2c3e5c6c9cde2e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:09:33.551035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606b53c6f60d45cf9e2c3e5c6c9cde2e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:09:33.557939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3bd2a71d-289f-41d3-b138-29ee9336e3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606b53c6f60d45cf9e2c3e5c6c9cde2e'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:09:33.564611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1246/2502] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:09:33 2022] DELETE /identity/v3/users/606b53c6f60d45cf9e2c3e5c6c9cde2e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:09:33.789461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d97185-078d-43c0-a3b3-39c113ef4407 service nova] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:33.803373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d97185-078d-43c0-a3b3-39c113ef4407 service nova] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:33.872893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:33.873892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:33.874181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:33.874464 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] PATH_INFO: `/v3/projects/bec19c8306c6439b9392248450d21ec9` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:33.884892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec19c8306c6439b9392248450d21ec9)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:33.887130 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:33.999529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec19c8306c6439b9392248450d21ec9', 'request_id': 'req-a6b31967-5a1d-4039-91f8-c972cda8679a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:09:34.004913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec19c8306c6439b9392248450d21ec9', 'request_id': 'req-a6b31967-5a1d-4039-91f8-c972cda8679a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:09:34.061548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec19c8306c6439b9392248450d21ec9', 'request_id': 'req-a6b31967-5a1d-4039-91f8-c972cda8679a'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:09:34.073538 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] The token cache is being invalidate because project bec19c8306c6439b9392248450d21ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:09:34.073831 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:09:34.074459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-a6b31967-5a1d-4039-91f8-c972cda8679a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:09:34.076142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1257/2503] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:09:33 2022] DELETE /identity/v3/projects/bec19c8306c6439b9392248450d21ec9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:09:34.082023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39972dce-31b3-4a03-a914-4654a4e12de5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:34.082383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39972dce-31b3-4a03-a914-4654a4e12de5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:34.082682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39972dce-31b3-4a03-a914-4654a4e12de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:34.101647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-39972dce-31b3-4a03-a914-4654a4e12de5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:09:34.102855 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-39972dce-31b3-4a03-a914-4654a4e12de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:09:34.160764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1247/2504] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:09:34.168805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36535c58-6fee-435d-83c3-75b765438059 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:34.169097 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36535c58-6fee-435d-83c3-75b765438059 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:34.169927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36535c58-6fee-435d-83c3-75b765438059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:34.188028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-36535c58-6fee-435d-83c3-75b765438059 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:09:34.189254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-36535c58-6fee-435d-83c3-75b765438059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:09:34.197012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1258/2505] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:09:34.201162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39972dce-31b3-4a03-a914-4654a4e12de5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:34.210939 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39972dce-31b3-4a03-a914-4654a4e12de5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:34.215501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b2658-b8cb-4edc-874c-1b300bec49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:34.216661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b2658-b8cb-4edc-874c-1b300bec49d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:34.216937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b2658-b8cb-4edc-874c-1b300bec49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:34.217259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b2658-b8cb-4edc-874c-1b300bec49d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:34.217978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b2658-b8cb-4edc-874c-1b300bec49d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:09:34.218285 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b2658-b8cb-4edc-874c-1b300bec49d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:34.219874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b2658-b8cb-4edc-874c-1b300bec49d9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:34.233894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1248/2506] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 21:09:34.237067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36535c58-6fee-435d-83c3-75b765438059 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:34.248971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36535c58-6fee-435d-83c3-75b765438059 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:34.253831 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cffa43-39e5-47fb-97b2-be43c39b0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:34.254491 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffa43-39e5-47fb-97b2-be43c39b0131 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:34.254775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffa43-39e5-47fb-97b2-be43c39b0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:34.255053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffa43-39e5-47fb-97b2-be43c39b0131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:34.255754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cffa43-39e5-47fb-97b2-be43c39b0131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:34.257678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cffa43-39e5-47fb-97b2-be43c39b0131 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:34.336595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1259/2507] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:09:34 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:09:34.339964 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b2658-b8cb-4edc-874c-1b300bec49d9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:34.350854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b2658-b8cb-4edc-874c-1b300bec49d9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:34.408440 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5887-b691-4447-8878-937824a761a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:34.409124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5887-b691-4447-8878-937824a761a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:34.409444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5887-b691-4447-8878-937824a761a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:34.409727 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5887-b691-4447-8878-937824a761a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:34.410477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5887-b691-4447-8878-937824a761a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:34.412338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5887-b691-4447-8878-937824a761a1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:34.496082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1249/2508] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:09:34 2022] POST /identity/v3/users => generated 303 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:09:34.500144 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cffa43-39e5-47fb-97b2-be43c39b0131 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:34.510615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cffa43-39e5-47fb-97b2-be43c39b0131 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:34.515969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff0c9d-c930-4f92-91b0-48669798a0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:34.516628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff0c9d-c930-4f92-91b0-48669798a0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:34.516960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff0c9d-c930-4f92-91b0-48669798a0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:34.517244 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff0c9d-c930-4f92-91b0-48669798a0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:34.518005 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff0c9d-c930-4f92-91b0-48669798a0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:34.521068 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff0c9d-c930-4f92-91b0-48669798a0d3 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:34.533380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1260/2509] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:09:34.538419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5887-b691-4447-8878-937824a761a1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:34.550242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5887-b691-4447-8878-937824a761a1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:34.556879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd061cc1-ad8e-4fb6-8316-30bc461ae1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:34.557988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061cc1-ad8e-4fb6-8316-30bc461ae1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:34.558421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061cc1-ad8e-4fb6-8316-30bc461ae1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:34.558846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061cc1-ad8e-4fb6-8316-30bc461ae1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:34.560039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd061cc1-ad8e-4fb6-8316-30bc461ae1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:34.562027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd061cc1-ad8e-4fb6-8316-30bc461ae1e1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:34.573817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1250/2510] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:09:34.579261 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff0c9d-c930-4f92-91b0-48669798a0d3 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:34.589219 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff0c9d-c930-4f92-91b0-48669798a0d3 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:34.594551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dc2a1-a0fb-44de-800e-00a69a1afe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:34.595431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dc2a1-a0fb-44de-800e-00a69a1afe3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:34.595718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dc2a1-a0fb-44de-800e-00a69a1afe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:34.595998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dc2a1-a0fb-44de-800e-00a69a1afe3a admin admin] PATH_INFO: `/v3/projects/93134bd4503a4c3aa9f684e41f456618/users/967813118ab64365b93c1e0fce5e188d/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:34.610345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dc2a1-a0fb-44de-800e-00a69a1afe3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93134bd4503a4c3aa9f684e41f456618, user_id=967813118ab64365b93c1e0fce5e188d, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:34.612990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dc2a1-a0fb-44de-800e-00a69a1afe3a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:34.696163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1261/2511] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:09:34 2022] PUT /identity/v3/projects/93134bd4503a4c3aa9f684e41f456618/users/967813118ab64365b93c1e0fce5e188d/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:09:34.707010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e199-335a-4e3b-8243-10d7d4e04b81 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:34.707304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e199-335a-4e3b-8243-10d7d4e04b81 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:34.707589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e199-335a-4e3b-8243-10d7d4e04b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:34.734388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a603e199-335a-4e3b-8243-10d7d4e04b81 None None] MFA Rules not processed for user `967813118ab64365b93c1e0fce5e188d`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:09:34.735581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a603e199-335a-4e3b-8243-10d7d4e04b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:09:34.799765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1251/2512] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:09:34.804202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dc2a1-a0fb-44de-800e-00a69a1afe3a admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:34.867896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dc2a1-a0fb-44de-800e-00a69a1afe3a admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:34.873625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4baeb-59a0-4897-bb3a-88108f91a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:34.874350 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4baeb-59a0-4897-bb3a-88108f91a944 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:34.874879 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4baeb-59a0-4897-bb3a-88108f91a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:34.875397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4baeb-59a0-4897-bb3a-88108f91a944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:34.876518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4baeb-59a0-4897-bb3a-88108f91a944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:34.879718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4baeb-59a0-4897-bb3a-88108f91a944 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:34.995264 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1262/2513] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:09:34 2022] POST /identity/v3/projects => generated 405 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:09:35.000181 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603e199-335a-4e3b-8243-10d7d4e04b81 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:35.011797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603e199-335a-4e3b-8243-10d7d4e04b81 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:35.072610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16727d19-2bf6-4dc7-813f-fb687f28a617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:35.073314 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16727d19-2bf6-4dc7-813f-fb687f28a617 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:35.073606 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16727d19-2bf6-4dc7-813f-fb687f28a617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:35.073887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16727d19-2bf6-4dc7-813f-fb687f28a617 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:35.074592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16727d19-2bf6-4dc7-813f-fb687f28a617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:35.077216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16727d19-2bf6-4dc7-813f-fb687f28a617 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:35.171526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1252/2514] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:09:34 2022] POST /identity/v3/users => generated 309 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:09:35.175578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4baeb-59a0-4897-bb3a-88108f91a944 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:35.186942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4baeb-59a0-4897-bb3a-88108f91a944 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:35.192405 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b97488-c417-4d9f-ad4c-b0d4c39795af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:35.193197 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b97488-c417-4d9f-ad4c-b0d4c39795af admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:35.193627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b97488-c417-4d9f-ad4c-b0d4c39795af admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:35.194028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b97488-c417-4d9f-ad4c-b0d4c39795af admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:35.194862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b97488-c417-4d9f-ad4c-b0d4c39795af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:35.196774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b97488-c417-4d9f-ad4c-b0d4c39795af admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:35.209251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1263/2515] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:09:35.213626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16727d19-2bf6-4dc7-813f-fb687f28a617 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:35.224611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16727d19-2bf6-4dc7-813f-fb687f28a617 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:35.231433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1c578-03c3-4274-bc07-58c91e8a8f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:35.232288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1c578-03c3-4274-bc07-58c91e8a8f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:35.232569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1c578-03c3-4274-bc07-58c91e8a8f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:35.232965 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1c578-03c3-4274-bc07-58c91e8a8f8b admin admin] PATH_INFO: `/v3/projects/9074ec3fbd004bd28605b372e474dd0c/users/22f70290159d4d8f9e11845430000279/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:35.248891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1c578-03c3-4274-bc07-58c91e8a8f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9074ec3fbd004bd28605b372e474dd0c, user_id=22f70290159d4d8f9e11845430000279, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:35.251570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1c578-03c3-4274-bc07-58c91e8a8f8b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:35.314577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1253/2516] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:09:35 2022] PUT /identity/v3/projects/9074ec3fbd004bd28605b372e474dd0c/users/22f70290159d4d8f9e11845430000279/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:09:35.318685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b97488-c417-4d9f-ad4c-b0d4c39795af admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:35.330426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b97488-c417-4d9f-ad4c-b0d4c39795af admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:35.399635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b6755-70e9-41b9-b09d-a38c15ff0ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:35.400310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6755-70e9-41b9-b09d-a38c15ff0ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:35.400598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6755-70e9-41b9-b09d-a38c15ff0ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:35.400878 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6755-70e9-41b9-b09d-a38c15ff0ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:35.401639 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6755-70e9-41b9-b09d-a38c15ff0ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:35.403243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6755-70e9-41b9-b09d-a38c15ff0ebf admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:35.413911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1264/2517] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:09:35.418153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1c578-03c3-4274-bc07-58c91e8a8f8b admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:09:35.428950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1c578-03c3-4274-bc07-58c91e8a8f8b admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:09:35.433748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48593c-6e88-4f12-b013-9ee151f8b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:09:35.434659 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48593c-6e88-4f12-b013-9ee151f8b4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:35.434962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48593c-6e88-4f12-b013-9ee151f8b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:35.435229 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48593c-6e88-4f12-b013-9ee151f8b4e3 admin admin] PATH_INFO: `/v3/projects/9074ec3fbd004bd28605b372e474dd0c/users/22f70290159d4d8f9e11845430000279/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:35.437618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48593c-6e88-4f12-b013-9ee151f8b4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9074ec3fbd004bd28605b372e474dd0c, user_id=22f70290159d4d8f9e11845430000279, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:09:35.440325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48593c-6e88-4f12-b013-9ee151f8b4e3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:09:35.451984 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1254/2518] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:09:35 2022] PUT /identity/v3/projects/9074ec3fbd004bd28605b372e474dd0c/users/22f70290159d4d8f9e11845430000279/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:09:35.462131 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8d19-42a8-4c8c-9ffd-6e4aa0ee1e5a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:09:35.462433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8d19-42a8-4c8c-9ffd-6e4aa0ee1e5a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:09:35.462715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8d19-42a8-4c8c-9ffd-6e4aa0ee1e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:09:35.491889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-4c2b8d19-42a8-4c8c-9ffd-6e4aa0ee1e5a None None] MFA Rules not processed for user `22f70290159d4d8f9e11845430000279`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:09:35.493147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4c2b8d19-42a8-4c8c-9ffd-6e4aa0ee1e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:09:35.560906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1265/2519] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:11:29.780731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48593c-6e88-4f12-b013-9ee151f8b4e3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:11:29.782731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8e48593c-6e88-4f12-b013-9ee151f8b4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:11:29.854933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48593c-6e88-4f12-b013-9ee151f8b4e3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:11:29.858564 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e933b-53d2-4711-ab2e-7f6f6e77aba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:11:29.859213 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e933b-53d2-4711-ab2e-7f6f6e77aba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:11:29.859496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e933b-53d2-4711-ab2e-7f6f6e77aba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:11:29.859772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e933b-53d2-4711-ab2e-7f6f6e77aba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:11:29.861653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7c1e933b-53d2-4711-ab2e-7f6f6e77aba6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:11:29.942206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e933b-53d2-4711-ab2e-7f6f6e77aba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:11:29.943635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e933b-53d2-4711-ab2e-7f6f6e77aba6 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:11:29.961681 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1255/2520] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:11:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:11:29.989100 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b8d19-42a8-4c8c-9ffd-6e4aa0ee1e5a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:11:29.998836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b8d19-42a8-4c8c-9ffd-6e4aa0ee1e5a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:11:30.002369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0caed-4842-4945-845b-710adb95e27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:11:30.003006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0caed-4842-4945-845b-710adb95e27c service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:11:30.003316 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0caed-4842-4945-845b-710adb95e27c service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:11:30.004175 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0caed-4842-4945-845b-710adb95e27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:11:30.013087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0caed-4842-4945-845b-710adb95e27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:11:30.014829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0caed-4842-4945-845b-710adb95e27c service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:11:30.025323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1266/2521] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:11:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:11:30.058524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e933b-53d2-4711-ab2e-7f6f6e77aba6 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:11:30.067600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e933b-53d2-4711-ab2e-7f6f6e77aba6 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:11:30.071233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c9857-0b04-4753-8ace-e6c080c22e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:11:30.071870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c9857-0b04-4753-8ace-e6c080c22e67 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:11:30.072154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c9857-0b04-4753-8ace-e6c080c22e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:11:30.072432 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c9857-0b04-4753-8ace-e6c080c22e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:11:30.074328 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f96c9857-0b04-4753-8ace-e6c080c22e67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:11:30.141382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c9857-0b04-4753-8ace-e6c080c22e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:11:30.147721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c9857-0b04-4753-8ace-e6c080c22e67 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:11:30.152943 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1256/2522] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:11:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:12:32.073546 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0caed-4842-4945-845b-710adb95e27c service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:12:32.074969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8ba0caed-4842-4945-845b-710adb95e27c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:12:32.182785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0caed-4842-4945-845b-710adb95e27c service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:12:32.187759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1322-16d4-4f42-8144-7848e4d85b20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:12:32.190387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1322-16d4-4f42-8144-7848e4d85b20 service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:12:32.190387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1322-16d4-4f42-8144-7848e4d85b20 service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:12:32.190387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1322-16d4-4f42-8144-7848e4d85b20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:12:32.190911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b11f1322-16d4-4f42-8144-7848e4d85b20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:12:32.203062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f1322-16d4-4f42-8144-7848e4d85b20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:12:32.204677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f1322-16d4-4f42-8144-7848e4d85b20 service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:12:32.215501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1267/2523] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:12:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:14:31.095238 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c9857-0b04-4753-8ace-e6c080c22e67 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:14:31.096833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f96c9857-0b04-4753-8ace-e6c080c22e67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:14:31.233300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c9857-0b04-4753-8ace-e6c080c22e67 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:14:31.239670 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c242d3-4f7b-49e9-bfd7-6defff21aef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:14:31.240316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c242d3-4f7b-49e9-bfd7-6defff21aef2 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:14:31.240597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c242d3-4f7b-49e9-bfd7-6defff21aef2 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:14:31.240873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c242d3-4f7b-49e9-bfd7-6defff21aef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:14:31.242661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a8c242d3-4f7b-49e9-bfd7-6defff21aef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:14:31.309251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c242d3-4f7b-49e9-bfd7-6defff21aef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:14:31.310868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c242d3-4f7b-49e9-bfd7-6defff21aef2 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:14:31.320301 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1257/2524] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:14:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:14:34.784364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1322-16d4-4f42-8144-7848e4d85b20 service placement] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:14:34.785854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b11f1322-16d4-4f42-8144-7848e4d85b20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:14:34.879453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1322-16d4-4f42-8144-7848e4d85b20 service placement] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:14:34.883129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c390f-b128-45ed-bdb6-3973f3895aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:14:34.883783 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c390f-b128-45ed-bdb6-3973f3895aba service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:14:34.884065 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c390f-b128-45ed-bdb6-3973f3895aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:14:34.884342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c390f-b128-45ed-bdb6-3973f3895aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:14:34.886141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b34c390f-b128-45ed-bdb6-3973f3895aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:14:34.896358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c390f-b128-45ed-bdb6-3973f3895aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:14:34.897822 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c390f-b128-45ed-bdb6-3973f3895aba service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:14:34.906553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1268/2525] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:27.136873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c242d3-4f7b-49e9-bfd7-6defff21aef2 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:27.160344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c242d3-4f7b-49e9-bfd7-6defff21aef2 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:27.166045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e70090-ce49-47af-8e97-0187279c0145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:27.166045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70090-ce49-47af-8e97-0187279c0145 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:27.166045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70090-ce49-47af-8e97-0187279c0145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:27.166045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70090-ce49-47af-8e97-0187279c0145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:27.167514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b9e70090-ce49-47af-8e97-0187279c0145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:27.228046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c390f-b128-45ed-bdb6-3973f3895aba service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:27.229526 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b34c390f-b128-45ed-bdb6-3973f3895aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:27.241629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c390f-b128-45ed-bdb6-3973f3895aba service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:27.248866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4c5ab-f12e-40d2-aa5d-679f131a7766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:27.248866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c5ab-f12e-40d2-aa5d-679f131a7766 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:27.248866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c5ab-f12e-40d2-aa5d-679f131a7766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:27.248866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c5ab-f12e-40d2-aa5d-679f131a7766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:27.249308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-82c4c5ab-f12e-40d2-aa5d-679f131a7766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:27.260686 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e70090-ce49-47af-8e97-0187279c0145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:27.262938 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e70090-ce49-47af-8e97-0187279c0145 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:27.287705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1258/2526] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:27.317746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4c5ab-f12e-40d2-aa5d-679f131a7766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:27.319550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4c5ab-f12e-40d2-aa5d-679f131a7766 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:27.332925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1269/2527] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:15:27.399284 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e70090-ce49-47af-8e97-0187279c0145 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:27.452847 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4c5ab-f12e-40d2-aa5d-679f131a7766 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:27.455328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-82c4c5ab-f12e-40d2-aa5d-679f131a7766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:27.473833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e70090-ce49-47af-8e97-0187279c0145 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:27.478913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:27.480369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:27.480656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:27.480936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] PATH_INFO: `/v3/users/967813118ab64365b93c1e0fce5e188d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:27.482180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967813118ab64365b93c1e0fce5e188d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:27.484315 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:27.525959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4c5ab-f12e-40d2-aa5d-679f131a7766 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:27.530867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:27.531797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:27.533461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:27.533784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] PATH_INFO: `/v3/users/ecbae1d4dc5842488f4bcbc4a6ed55ee` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:27.535070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecbae1d4dc5842488f4bcbc4a6ed55ee)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:27.537008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:27.706368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967813118ab64365b93c1e0fce5e188d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:27.718643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967813118ab64365b93c1e0fce5e188d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:27.719318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967813118ab64365b93c1e0fce5e188d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:27.763080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecbae1d4dc5842488f4bcbc4a6ed55ee'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:27.763915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecbae1d4dc5842488f4bcbc4a6ed55ee'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:27.764899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecbae1d4dc5842488f4bcbc4a6ed55ee'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:27.779100 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecbae1d4dc5842488f4bcbc4a6ed55ee'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:27.786198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-aecaf20a-3230-46f5-9c25-39821582040d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecbae1d4dc5842488f4bcbc4a6ed55ee'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:27.787132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967813118ab64365b93c1e0fce5e188d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:27.794655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-0e248061-8c13-4949-b4b3-ab2ab35b4fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967813118ab64365b93c1e0fce5e188d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:27.800690 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1259/2528] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:27 2022] DELETE /identity/v3/users/967813118ab64365b93c1e0fce5e188d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:27.805026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dc40c-2009-4748-8c17-abdd69c35039 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:27.805412 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dc40c-2009-4748-8c17-abdd69c35039 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:27.805699 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dc40c-2009-4748-8c17-abdd69c35039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:27.833439 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-a66dc40c-2009-4748-8c17-abdd69c35039 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:27.834693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a66dc40c-2009-4748-8c17-abdd69c35039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:27.851015 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1270/2529] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:27 2022] DELETE /identity/v3/users/ecbae1d4dc5842488f4bcbc4a6ed55ee => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:27.860493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a4c01-9927-4118-bc6e-e976396c05d5 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:27.860991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a4c01-9927-4118-bc6e-e976396c05d5 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:27.861422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a4c01-9927-4118-bc6e-e976396c05d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:27.884700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-157a4c01-9927-4118-bc6e-e976396c05d5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:27.886184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-157a4c01-9927-4118-bc6e-e976396c05d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:27.919468 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1260/2530] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:27.933543 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dc40c-2009-4748-8c17-abdd69c35039 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:27.936178 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a66dc40c-2009-4748-8c17-abdd69c35039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:27.962749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1271/2531] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:27.968947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a4c01-9927-4118-bc6e-e976396c05d5 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:27.970798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-157a4c01-9927-4118-bc6e-e976396c05d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:28.002894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dc40c-2009-4748-8c17-abdd69c35039 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:28.036763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a4c01-9927-4118-bc6e-e976396c05d5 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:28.041255 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d579bf-be0f-454a-ae15-8e332d7d8454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:28.042152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d579bf-be0f-454a-ae15-8e332d7d8454 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:28.043040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d579bf-be0f-454a-ae15-8e332d7d8454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:28.043040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d579bf-be0f-454a-ae15-8e332d7d8454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:28.054777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d579bf-be0f-454a-ae15-8e332d7d8454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:28.056581 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d579bf-be0f-454a-ae15-8e332d7d8454 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:28.059082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3619e5-5016-46d1-b19f-b4623e0b38b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:28.059250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3619e5-5016-46d1-b19f-b4623e0b38b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:28.059449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3619e5-5016-46d1-b19f-b4623e0b38b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:28.059717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3619e5-5016-46d1-b19f-b4623e0b38b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:28.067916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1272/2532] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:15:28.070761 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3619e5-5016-46d1-b19f-b4623e0b38b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:28.072257 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3619e5-5016-46d1-b19f-b4623e0b38b1 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:28.082261 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1261/2533] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:15:28.635449 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d579bf-be0f-454a-ae15-8e332d7d8454 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:28.637046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-36d579bf-be0f-454a-ae15-8e332d7d8454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:28.651124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3619e5-5016-46d1-b19f-b4623e0b38b1 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:28.651598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d579bf-be0f-454a-ae15-8e332d7d8454 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:28.653394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8f3619e5-5016-46d1-b19f-b4623e0b38b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:28.658571 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:28.659434 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:28.659760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:28.660077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] PATH_INFO: `/v3/projects/aba1b049f3e54c4da6e54c994722399e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:28.663125 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba1b049f3e54c4da6e54c994722399e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:28.665051 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:28.667749 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3619e5-5016-46d1-b19f-b4623e0b38b1 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:28.673491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:28.677046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:28.677046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:28.677046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] PATH_INFO: `/v3/projects/93134bd4503a4c3aa9f684e41f456618` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:28.677046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93134bd4503a4c3aa9f684e41f456618)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:28.678203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:28.776305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba1b049f3e54c4da6e54c994722399e', 'request_id': 'req-81c29365-5198-4b54-9980-dfc7ddda6376'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:28.781561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba1b049f3e54c4da6e54c994722399e', 'request_id': 'req-81c29365-5198-4b54-9980-dfc7ddda6376'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:28.805751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93134bd4503a4c3aa9f684e41f456618', 'request_id': 'req-536e1521-135e-48d5-9615-4bef2224f6e7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:28.811351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93134bd4503a4c3aa9f684e41f456618', 'request_id': 'req-536e1521-135e-48d5-9615-4bef2224f6e7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:28.844284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba1b049f3e54c4da6e54c994722399e', 'request_id': 'req-81c29365-5198-4b54-9980-dfc7ddda6376'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:28.857065 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] The token cache is being invalidate because project aba1b049f3e54c4da6e54c994722399e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:28.857392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:28.858061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:28.863359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1273/2534] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:28 2022] DELETE /identity/v3/projects/aba1b049f3e54c4da6e54c994722399e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:28.868171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:28.869611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:28.930233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93134bd4503a4c3aa9f684e41f456618', 'request_id': 'req-536e1521-135e-48d5-9615-4bef2224f6e7'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:28.942488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] The token cache is being invalidate because project 93134bd4503a4c3aa9f684e41f456618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:28.942886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:28.943580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:28.945204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1262/2535] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:28 2022] DELETE /identity/v3/projects/93134bd4503a4c3aa9f684e41f456618 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:28.949164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:28.950264 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c29365-5198-4b54-9980-dfc7ddda6376 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:28.950604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:29.010392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:29.011276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:29.011565 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:29.011850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] PATH_INFO: `/v3/users/2e600815021c4186817c4d9ffe02d03d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:29.018099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e1521-135e-48d5-9615-4bef2224f6e7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:29.023206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:29.024092 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:29.024373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:29.024652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] PATH_INFO: `/v3/users/22f70290159d4d8f9e11845430000279` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:29.025872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f70290159d4d8f9e11845430000279)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:29.027224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e600815021c4186817c4d9ffe02d03d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:29.027788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:29.029159 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:29.246626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f70290159d4d8f9e11845430000279'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:29.258171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f70290159d4d8f9e11845430000279'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:29.264741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f70290159d4d8f9e11845430000279'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:29.275789 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e600815021c4186817c4d9ffe02d03d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:29.276443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e600815021c4186817c4d9ffe02d03d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:29.277049 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e600815021c4186817c4d9ffe02d03d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:29.289566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e600815021c4186817c4d9ffe02d03d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:29.296228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e600815021c4186817c4d9ffe02d03d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:29.347889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f70290159d4d8f9e11845430000279'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:29.355109 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f70290159d4d8f9e11845430000279'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:29.361656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1263/2536] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:28 2022] DELETE /identity/v3/users/22f70290159d4d8f9e11845430000279 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:29.422041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1274/2537] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:28 2022] DELETE /identity/v3/users/2e600815021c4186817c4d9ffe02d03d => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:29.773105 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:29.774692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:29.803621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:29.805109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:29.862227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f66243-0c08-4d8e-8223-e64acb3a8e77 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:29.874225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8a0e0-3860-4d59-b6e8-c85daf0bf1ba admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:29.879419 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:29.880308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:29.880592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:29.880867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] PATH_INFO: `/v3/projects/62b5b8e89e51493e8cc0b5dd73435b48` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:29.891851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b5b8e89e51493e8cc0b5dd73435b48)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:29.893823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:29.919819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:29.920690 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:29.920977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:29.921395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] PATH_INFO: `/v3/projects/9074ec3fbd004bd28605b372e474dd0c` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:29.922486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9074ec3fbd004bd28605b372e474dd0c)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:29.925069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.000753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b5b8e89e51493e8cc0b5dd73435b48', 'request_id': 'req-2e65e673-4904-4ed7-ac7b-09a3760e2f69'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:30.008511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b5b8e89e51493e8cc0b5dd73435b48', 'request_id': 'req-2e65e673-4904-4ed7-ac7b-09a3760e2f69'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:30.014569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9074ec3fbd004bd28605b372e474dd0c', 'request_id': 'req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:30.021958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9074ec3fbd004bd28605b372e474dd0c', 'request_id': 'req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:30.067324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b5b8e89e51493e8cc0b5dd73435b48', 'request_id': 'req-2e65e673-4904-4ed7-ac7b-09a3760e2f69'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:30.079935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] The token cache is being invalidate because project 62b5b8e89e51493e8cc0b5dd73435b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:30.080513 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:30.080811 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e65e673-4904-4ed7-ac7b-09a3760e2f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:30.082403 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1275/2538] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:29 2022] DELETE /identity/v3/projects/62b5b8e89e51493e8cc0b5dd73435b48 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:30.088426 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e224d7-c0a5-4b63-9878-3e3a645c2c66 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.088716 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e224d7-c0a5-4b63-9878-3e3a645c2c66 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.089002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e224d7-c0a5-4b63-9878-3e3a645c2c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.113121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9074ec3fbd004bd28605b372e474dd0c', 'request_id': 'req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:30.124646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] The token cache is being invalidate because project 9074ec3fbd004bd28605b372e474dd0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:30.126702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:30.126702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3d60a8fa-c2f9-451f-b6c6-9e6f4a39e059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:30.127846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1264/2539] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:29 2022] DELETE /identity/v3/projects/9074ec3fbd004bd28605b372e474dd0c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:30.132785 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194eb70-25e5-45f8-8512-8555ab4fe640 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.133153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194eb70-25e5-45f8-8512-8555ab4fe640 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.133465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194eb70-25e5-45f8-8512-8555ab4fe640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.135259 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-97e224d7-c0a5-4b63-9878-3e3a645c2c66 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:30.136470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-97e224d7-c0a5-4b63-9878-3e3a645c2c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:30.152382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3194eb70-25e5-45f8-8512-8555ab4fe640 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:30.153649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3194eb70-25e5-45f8-8512-8555ab4fe640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:30.196276 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1276/2540] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:30.203825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeaf9f-d804-440c-9c19-57a208358460 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.204686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeaf9f-d804-440c-9c19-57a208358460 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.204995 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeaf9f-d804-440c-9c19-57a208358460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.212405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1265/2541] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:30.222258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ccd1-4624-451d-a8b2-e0594de074f9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.222764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ccd1-4624-451d-a8b2-e0594de074f9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.223124 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50ccd1-4624-451d-a8b2-e0594de074f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.227876 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-37aeaf9f-d804-440c-9c19-57a208358460 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:30.229102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-37aeaf9f-d804-440c-9c19-57a208358460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:30.238302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1277/2542] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:30.242073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeaf9f-d804-440c-9c19-57a208358460 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.245747 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-fe50ccd1-4624-451d-a8b2-e0594de074f9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:30.246951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fe50ccd1-4624-451d-a8b2-e0594de074f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:30.255534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1266/2543] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:30.256488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeaf9f-d804-440c-9c19-57a208358460 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.259483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50ccd1-4624-451d-a8b2-e0594de074f9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.261318 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befef90d-71f4-460c-b635-f27a108e59b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.262080 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef90d-71f4-460c-b635-f27a108e59b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.262373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef90d-71f4-460c-b635-f27a108e59b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.262655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef90d-71f4-460c-b635-f27a108e59b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.263396 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befef90d-71f4-460c-b635-f27a108e59b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:15:30.263828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befef90d-71f4-460c-b635-f27a108e59b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.265535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befef90d-71f4-460c-b635-f27a108e59b1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.269546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50ccd1-4624-451d-a8b2-e0594de074f9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.275505 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a6044-139d-4eb7-afa9-c5b1a525dceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.276283 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6044-139d-4eb7-afa9-c5b1a525dceb admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.276573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6044-139d-4eb7-afa9-c5b1a525dceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.276853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6044-139d-4eb7-afa9-c5b1a525dceb admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.277635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a6044-139d-4eb7-afa9-c5b1a525dceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:15:30.277948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a6044-139d-4eb7-afa9-c5b1a525dceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.279153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1278/2544] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 21:15:30.283326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a6044-139d-4eb7-afa9-c5b1a525dceb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.284496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befef90d-71f4-460c-b635-f27a108e59b1 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.294235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befef90d-71f4-460c-b635-f27a108e59b1 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.300420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1267/2545] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:15:30.300582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c7d3d-56b1-498c-851e-2cbfcf271e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.301595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a6044-139d-4eb7-afa9-c5b1a525dceb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.301734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c7d3d-56b1-498c-851e-2cbfcf271e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.302066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c7d3d-56b1-498c-851e-2cbfcf271e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.302488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c7d3d-56b1-498c-851e-2cbfcf271e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.303627 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c7d3d-56b1-498c-851e-2cbfcf271e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.306692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c7d3d-56b1-498c-851e-2cbfcf271e54 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.311671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a6044-139d-4eb7-afa9-c5b1a525dceb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.316922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d605be-cdee-4d91-96bd-75ffbe541424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.317620 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d605be-cdee-4d91-96bd-75ffbe541424 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.317911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d605be-cdee-4d91-96bd-75ffbe541424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.318192 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d605be-cdee-4d91-96bd-75ffbe541424 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.319080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d605be-cdee-4d91-96bd-75ffbe541424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.320867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d605be-cdee-4d91-96bd-75ffbe541424 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.412388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1279/2546] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:30.416514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c7d3d-56b1-498c-851e-2cbfcf271e54 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.426400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1268/2547] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:30.427503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d605be-cdee-4d91-96bd-75ffbe541424 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.480210 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c7d3d-56b1-498c-851e-2cbfcf271e54 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.490971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d605be-cdee-4d91-96bd-75ffbe541424 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.495703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c48ee6-4460-45bb-b35b-a3daa17e20f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.496379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c48ee6-4460-45bb-b35b-a3daa17e20f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.496668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c48ee6-4460-45bb-b35b-a3daa17e20f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.496950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c48ee6-4460-45bb-b35b-a3daa17e20f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.497679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c48ee6-4460-45bb-b35b-a3daa17e20f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.499611 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c48ee6-4460-45bb-b35b-a3daa17e20f4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.536795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c649b6-7e6a-4924-97cf-db147274308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.537504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c649b6-7e6a-4924-97cf-db147274308d admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.537791 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c649b6-7e6a-4924-97cf-db147274308d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.538071 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c649b6-7e6a-4924-97cf-db147274308d admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.538756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c649b6-7e6a-4924-97cf-db147274308d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.540701 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c649b6-7e6a-4924-97cf-db147274308d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.589023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1269/2548] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:30.593037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c48ee6-4460-45bb-b35b-a3daa17e20f4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.602564 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c48ee6-4460-45bb-b35b-a3daa17e20f4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.608627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752cf59-b98c-4225-bc12-9719c45c5461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.609367 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752cf59-b98c-4225-bc12-9719c45c5461 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.609654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752cf59-b98c-4225-bc12-9719c45c5461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.609932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752cf59-b98c-4225-bc12-9719c45c5461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.611057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752cf59-b98c-4225-bc12-9719c45c5461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.612604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752cf59-b98c-4225-bc12-9719c45c5461 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.617949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1280/2549] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:15:30.624601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1270/2550] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:30.625737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c649b6-7e6a-4924-97cf-db147274308d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.627583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752cf59-b98c-4225-bc12-9719c45c5461 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.636522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c649b6-7e6a-4924-97cf-db147274308d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.637199 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752cf59-b98c-4225-bc12-9719c45c5461 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.642561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9edd-9df2-42f7-bfe1-273200c7b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.642744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a332-665e-47ae-90f1-1fea6b5bcee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.643333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9edd-9df2-42f7-bfe1-273200c7b80c admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.643519 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a332-665e-47ae-90f1-1fea6b5bcee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.643641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9edd-9df2-42f7-bfe1-273200c7b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.643803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a332-665e-47ae-90f1-1fea6b5bcee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.643920 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9edd-9df2-42f7-bfe1-273200c7b80c admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.644080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a332-665e-47ae-90f1-1fea6b5bcee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.644604 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee9edd-9df2-42f7-bfe1-273200c7b80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.644799 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4a332-665e-47ae-90f1-1fea6b5bcee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.646527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee9edd-9df2-42f7-bfe1-273200c7b80c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.646667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4a332-665e-47ae-90f1-1fea6b5bcee9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.659656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1271/2551] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:30.659835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1281/2552] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:30.660542 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a332-665e-47ae-90f1-1fea6b5bcee9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.660908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9edd-9df2-42f7-bfe1-273200c7b80c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.670165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a332-665e-47ae-90f1-1fea6b5bcee9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.670573 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9edd-9df2-42f7-bfe1-273200c7b80c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.675149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9125d6b-6db1-44a1-8bc4-a0b3ac4a49df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.675370 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13aef3-c01f-4072-9c20-be59e377a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.675803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9125d6b-6db1-44a1-8bc4-a0b3ac4a49df admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.676087 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9125d6b-6db1-44a1-8bc4-a0b3ac4a49df admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.676231 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13aef3-c01f-4072-9c20-be59e377a733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.676362 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9125d6b-6db1-44a1-8bc4-a0b3ac4a49df admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.676517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13aef3-c01f-4072-9c20-be59e377a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.676799 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13aef3-c01f-4072-9c20-be59e377a733 admin admin] PATH_INFO: `/v3/projects/f69c722ec0a54102b28a9058d1afe077/users/7af50709f71b4655b518fdf9bfd15e81/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.677083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9125d6b-6db1-44a1-8bc4-a0b3ac4a49df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.678716 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9125d6b-6db1-44a1-8bc4-a0b3ac4a49df admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.689753 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1272/2553] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:30.692699 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13aef3-c01f-4072-9c20-be59e377a733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69c722ec0a54102b28a9058d1afe077, user_id=7af50709f71b4655b518fdf9bfd15e81, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.693849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9125d6b-6db1-44a1-8bc4-a0b3ac4a49df admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.695690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13aef3-c01f-4072-9c20-be59e377a733 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.703474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9125d6b-6db1-44a1-8bc4-a0b3ac4a49df admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.709455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf29a0-0d37-4665-a81e-decf10a3442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.711582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf29a0-0d37-4665-a81e-decf10a3442f admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.711582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf29a0-0d37-4665-a81e-decf10a3442f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.711582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf29a0-0d37-4665-a81e-decf10a3442f admin admin] PATH_INFO: `/v3/projects/aad22dff041d4d399d0004c0627b44b8/users/d8f5b51020a942e58a08a6990ea12fe7/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.725839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf29a0-0d37-4665-a81e-decf10a3442f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad22dff041d4d399d0004c0627b44b8, user_id=d8f5b51020a942e58a08a6990ea12fe7, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.728449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf29a0-0d37-4665-a81e-decf10a3442f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.770444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1282/2554] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:30 2022] PUT /identity/v3/projects/f69c722ec0a54102b28a9058d1afe077/users/7af50709f71b4655b518fdf9bfd15e81/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:30.775596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765022-0341-4cee-95fd-ac833c578899 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.775836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765022-0341-4cee-95fd-ac833c578899 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.776122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765022-0341-4cee-95fd-ac833c578899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.794733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8a765022-0341-4cee-95fd-ac833c578899 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:30.795956 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8a765022-0341-4cee-95fd-ac833c578899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:30.799748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1273/2555] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:30 2022] PUT /identity/v3/projects/aad22dff041d4d399d0004c0627b44b8/users/d8f5b51020a942e58a08a6990ea12fe7/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:30.814372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677b63c-a780-4916-9e70-4682876c7fd2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.814748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677b63c-a780-4916-9e70-4682876c7fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.815099 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677b63c-a780-4916-9e70-4682876c7fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.841160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2677b63c-a780-4916-9e70-4682876c7fd2 None None] MFA Rules not processed for user `d8f5b51020a942e58a08a6990ea12fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:30.842424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2677b63c-a780-4916-9e70-4682876c7fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:30.856136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1283/2556] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:30.866325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765022-0341-4cee-95fd-ac833c578899 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.867743 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8a765022-0341-4cee-95fd-ac833c578899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:30.921065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1274/2557] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:30.921411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677b63c-a780-4916-9e70-4682876c7fd2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:30.933164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677b63c-a780-4916-9e70-4682876c7fd2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.934141 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765022-0341-4cee-95fd-ac833c578899 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:30.937809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63348837-ae67-4249-874f-58ef545408ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.938463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63348837-ae67-4249-874f-58ef545408ec service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.939617 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63348837-ae67-4249-874f-58ef545408ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.940012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5d30f-1e66-4348-9d9e-acba158b0341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:30.940156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63348837-ae67-4249-874f-58ef545408ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.940848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5d30f-1e66-4348-9d9e-acba158b0341 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:30.941201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5d30f-1e66-4348-9d9e-acba158b0341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:30.941641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5d30f-1e66-4348-9d9e-acba158b0341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:30.942357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5d30f-1e66-4348-9d9e-acba158b0341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.944256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5d30f-1e66-4348-9d9e-acba158b0341 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.950560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63348837-ae67-4249-874f-58ef545408ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:30.951994 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63348837-ae67-4249-874f-58ef545408ec service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:30.961908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1284/2558] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:31.052694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1275/2559] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:30 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:15:31.056790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63348837-ae67-4249-874f-58ef545408ec service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:31.067289 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63348837-ae67-4249-874f-58ef545408ec service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:31.123635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa7d0d-7837-4e5e-aa97-7c55b8ad2f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:31.124327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa7d0d-7837-4e5e-aa97-7c55b8ad2f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:31.124614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa7d0d-7837-4e5e-aa97-7c55b8ad2f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:31.124895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa7d0d-7837-4e5e-aa97-7c55b8ad2f12 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:31.125622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa7d0d-7837-4e5e-aa97-7c55b8ad2f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:31.128205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa7d0d-7837-4e5e-aa97-7c55b8ad2f12 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:31.205293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1285/2560] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:31 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:31.209243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5d30f-1e66-4348-9d9e-acba158b0341 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:31.219730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5d30f-1e66-4348-9d9e-acba158b0341 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:31.224705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f47931-1f4d-4a85-bee8-b2847eccbe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:31.225488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f47931-1f4d-4a85-bee8-b2847eccbe93 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:31.225846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f47931-1f4d-4a85-bee8-b2847eccbe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:31.226136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f47931-1f4d-4a85-bee8-b2847eccbe93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:31.226872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f47931-1f4d-4a85-bee8-b2847eccbe93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:31.228486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f47931-1f4d-4a85-bee8-b2847eccbe93 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:31.240037 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1276/2561] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:31.244179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa7d0d-7837-4e5e-aa97-7c55b8ad2f12 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:31.255718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa7d0d-7837-4e5e-aa97-7c55b8ad2f12 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:31.262218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f6cd-1233-41d0-9cfb-bd05d22cff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:31.265073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f6cd-1233-41d0-9cfb-bd05d22cff8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:31.265073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f6cd-1233-41d0-9cfb-bd05d22cff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:31.265073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f6cd-1233-41d0-9cfb-bd05d22cff8b admin admin] PATH_INFO: `/v3/projects/bc4b2b41c9e34e349dd211388130fdf2/users/08040093511b41c7b7e80bba4b0849cd/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:31.282380 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34f6cd-1233-41d0-9cfb-bd05d22cff8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4b2b41c9e34e349dd211388130fdf2, user_id=08040093511b41c7b7e80bba4b0849cd, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:31.285769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34f6cd-1233-41d0-9cfb-bd05d22cff8b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:31.376763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1286/2562] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:31 2022] PUT /identity/v3/projects/bc4b2b41c9e34e349dd211388130fdf2/users/08040093511b41c7b7e80bba4b0849cd/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:31.380875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f47931-1f4d-4a85-bee8-b2847eccbe93 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:31.391097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f47931-1f4d-4a85-bee8-b2847eccbe93 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:31.448480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cacace-fc14-4727-b87a-1fc3844b6497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:31.449200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cacace-fc14-4727-b87a-1fc3844b6497 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:31.449524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cacace-fc14-4727-b87a-1fc3844b6497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:31.449788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cacace-fc14-4727-b87a-1fc3844b6497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:31.450540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cacace-fc14-4727-b87a-1fc3844b6497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:31.452135 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cacace-fc14-4727-b87a-1fc3844b6497 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:31.465613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1277/2563] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:31.467178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f6cd-1233-41d0-9cfb-bd05d22cff8b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:31.480836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f6cd-1233-41d0-9cfb-bd05d22cff8b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:31.486739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae3bb3-b258-486d-a0fe-d0d3a9525733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:31.487806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3bb3-b258-486d-a0fe-d0d3a9525733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:31.488095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3bb3-b258-486d-a0fe-d0d3a9525733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:31.488375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae3bb3-b258-486d-a0fe-d0d3a9525733 admin admin] PATH_INFO: `/v3/projects/bc4b2b41c9e34e349dd211388130fdf2/users/08040093511b41c7b7e80bba4b0849cd/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:31.490576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae3bb3-b258-486d-a0fe-d0d3a9525733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4b2b41c9e34e349dd211388130fdf2, user_id=08040093511b41c7b7e80bba4b0849cd, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:31.493222 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae3bb3-b258-486d-a0fe-d0d3a9525733 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:31.504027 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1287/2564] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:31 2022] PUT /identity/v3/projects/bc4b2b41c9e34e349dd211388130fdf2/users/08040093511b41c7b7e80bba4b0849cd/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:31.514417 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e68b2-42c2-4fbe-9715-5d5b7d0b82b5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:31.514711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e68b2-42c2-4fbe-9715-5d5b7d0b82b5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:31.514994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e68b2-42c2-4fbe-9715-5d5b7d0b82b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:31.543904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-553e68b2-42c2-4fbe-9715-5d5b7d0b82b5 None None] MFA Rules not processed for user `08040093511b41c7b7e80bba4b0849cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:31.545626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-553e68b2-42c2-4fbe-9715-5d5b7d0b82b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:31.615807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1278/2565] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:31.628567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae3bb3-b258-486d-a0fe-d0d3a9525733 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:31.630291 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b1ae3bb3-b258-486d-a0fe-d0d3a9525733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:31.692717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae3bb3-b258-486d-a0fe-d0d3a9525733 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:31.697618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b0aec-3120-4806-b09a-aba989a0c3ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:31.698295 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b0aec-3120-4806-b09a-aba989a0c3ef service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:31.698579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b0aec-3120-4806-b09a-aba989a0c3ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:31.698857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b0aec-3120-4806-b09a-aba989a0c3ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:31.708947 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b0aec-3120-4806-b09a-aba989a0c3ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:31.710432 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b0aec-3120-4806-b09a-aba989a0c3ef service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:31.720550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1288/2566] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:15:32.263502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172a906-c378-4344-b049-e78b224268a9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:32.263986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172a906-c378-4344-b049-e78b224268a9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:32.273445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172a906-c378-4344-b049-e78b224268a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:32.292026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e172a906-c378-4344-b049-e78b224268a9 None None] MFA Rules not processed for user `7af50709f71b4655b518fdf9bfd15e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:32.293238 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e172a906-c378-4344-b049-e78b224268a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:32.360112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1279/2567] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:32.364851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b0aec-3120-4806-b09a-aba989a0c3ef service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:32.430821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b0aec-3120-4806-b09a-aba989a0c3ef service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:32.435482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef590-9d85-40d9-a966-f33356b6fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:32.436142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef590-9d85-40d9-a966-f33356b6fbbc admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:32.436428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef590-9d85-40d9-a966-f33356b6fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:32.436865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef590-9d85-40d9-a966-f33356b6fbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:32.437611 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef590-9d85-40d9-a966-f33356b6fbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:32.442362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef590-9d85-40d9-a966-f33356b6fbbc admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:32.567327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1289/2568] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:32 2022] POST /identity/v3/projects => generated 405 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:32.571296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172a906-c378-4344-b049-e78b224268a9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:32.581966 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172a906-c378-4344-b049-e78b224268a9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:32.638839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bab11-933d-4a81-a4b1-7880b18538c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:32.639514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bab11-933d-4a81-a4b1-7880b18538c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:32.639798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bab11-933d-4a81-a4b1-7880b18538c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:32.640071 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bab11-933d-4a81-a4b1-7880b18538c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:32.640840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bab11-933d-4a81-a4b1-7880b18538c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:32.642881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bab11-933d-4a81-a4b1-7880b18538c2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:32.719754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef590-9d85-40d9-a966-f33356b6fbbc admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:32.730429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1280/2569] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:32 2022] POST /identity/v3/users => generated 309 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:32.731511 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bab11-933d-4a81-a4b1-7880b18538c2 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:32.741852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bab11-933d-4a81-a4b1-7880b18538c2 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:32.746535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea102e7-60e3-46c6-b144-137a0cea8bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:32.747194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea102e7-60e3-46c6-b144-137a0cea8bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:32.747480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea102e7-60e3-46c6-b144-137a0cea8bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:32.747757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea102e7-60e3-46c6-b144-137a0cea8bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:32.748481 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea102e7-60e3-46c6-b144-137a0cea8bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:32.750191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea102e7-60e3-46c6-b144-137a0cea8bb1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:32.762677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1281/2570] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:32.767320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea102e7-60e3-46c6-b144-137a0cea8bb1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:32.778509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea102e7-60e3-46c6-b144-137a0cea8bb1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:32.784775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c31af8-be68-4c18-af17-69e257811a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:32.785704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c31af8-be68-4c18-af17-69e257811a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:32.786080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c31af8-be68-4c18-af17-69e257811a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:32.786434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c31af8-be68-4c18-af17-69e257811a69 admin admin] PATH_INFO: `/v3/projects/b8b0ed9e6f6c491ab37b7013ea23b742/users/298d03f14c404314a4f142a5b273948a/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:32.786728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef590-9d85-40d9-a966-f33356b6fbbc admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:32.791421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefaa0d0-7342-49c9-bf55-deee73024656 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08040093511b41c7b7e80bba4b0849cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc4b2b41c9e34e349dd211388130fdf2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:32.794728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaa0d0-7342-49c9-bf55-deee73024656 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:32.794728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaa0d0-7342-49c9-bf55-deee73024656 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:32.794728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaa0d0-7342-49c9-bf55-deee73024656 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:32.794728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefaa0d0-7342-49c9-bf55-deee73024656 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:15:32.794728 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefaa0d0-7342-49c9-bf55-deee73024656 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:32.795322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefaa0d0-7342-49c9-bf55-deee73024656 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:32.802947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c31af8-be68-4c18-af17-69e257811a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b0ed9e6f6c491ab37b7013ea23b742, user_id=298d03f14c404314a4f142a5b273948a, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:32.805660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c31af8-be68-4c18-af17-69e257811a69 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:32.807479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1290/2571] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 21:15:32.811479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefaa0d0-7342-49c9-bf55-deee73024656 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:32.822638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefaa0d0-7342-49c9-bf55-deee73024656 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:32.827345 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b9d66-beee-4f3f-bc3f-7dfb08647b1c tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08040093511b41c7b7e80bba4b0849cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc4b2b41c9e34e349dd211388130fdf2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:32.827979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b9d66-beee-4f3f-bc3f-7dfb08647b1c tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:32.828265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b9d66-beee-4f3f-bc3f-7dfb08647b1c tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:32.828545 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b9d66-beee-4f3f-bc3f-7dfb08647b1c tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:32.830415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b9d66-beee-4f3f-bc3f-7dfb08647b1c tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:32.832300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b9d66-beee-4f3f-bc3f-7dfb08647b1c tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:32.879423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1282/2572] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:32 2022] PUT /identity/v3/projects/b8b0ed9e6f6c491ab37b7013ea23b742/users/298d03f14c404314a4f142a5b273948a/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:32.883224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c31af8-be68-4c18-af17-69e257811a69 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:32.929640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1291/2573] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:32 2022] POST /identity/v3/projects => generated 355 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:15:32.930697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b9d66-beee-4f3f-bc3f-7dfb08647b1c tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:32.947462 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c31af8-be68-4c18-af17-69e257811a69 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:33.002877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b9d66-beee-4f3f-bc3f-7dfb08647b1c tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:33.005751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450c8fe-7098-443a-add9-9942e992f8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:33.006435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450c8fe-7098-443a-add9-9942e992f8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:33.006724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450c8fe-7098-443a-add9-9942e992f8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:33.007003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450c8fe-7098-443a-add9-9942e992f8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:33.007731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450c8fe-7098-443a-add9-9942e992f8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:33.008566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a1513-ab90-4a45-a0d4-e1e4ca1cf2cc tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08040093511b41c7b7e80bba4b0849cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc4b2b41c9e34e349dd211388130fdf2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:33.009314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a1513-ab90-4a45-a0d4-e1e4ca1cf2cc tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:33.009431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450c8fe-7098-443a-add9-9942e992f8f4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:33.009616 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a1513-ab90-4a45-a0d4-e1e4ca1cf2cc tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:33.009902 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a1513-ab90-4a45-a0d4-e1e4ca1cf2cc tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:33.010998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a1513-ab90-4a45-a0d4-e1e4ca1cf2cc tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:15:33.011323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a1513-ab90-4a45-a0d4-e1e4ca1cf2cc tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:33.013895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a1513-ab90-4a45-a0d4-e1e4ca1cf2cc tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:33.020398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1283/2574] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:33.024692 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450c8fe-7098-443a-add9-9942e992f8f4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:33.028784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1292/2575] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:15:33.036028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450c8fe-7098-443a-add9-9942e992f8f4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:33.040474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e63cd2-78e9-4462-95d0-252f35cac8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:33.041396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e63cd2-78e9-4462-95d0-252f35cac8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:33.041682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e63cd2-78e9-4462-95d0-252f35cac8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:33.041958 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e63cd2-78e9-4462-95d0-252f35cac8e5 admin admin] PATH_INFO: `/v3/projects/b8b0ed9e6f6c491ab37b7013ea23b742/users/298d03f14c404314a4f142a5b273948a/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:33.043930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e63cd2-78e9-4462-95d0-252f35cac8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b0ed9e6f6c491ab37b7013ea23b742, user_id=298d03f14c404314a4f142a5b273948a, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:33.047419 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e63cd2-78e9-4462-95d0-252f35cac8e5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:33.058472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1284/2576] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:33 2022] PUT /identity/v3/projects/b8b0ed9e6f6c491ab37b7013ea23b742/users/298d03f14c404314a4f142a5b273948a/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:33.068918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a1513-ab90-4a45-a0d4-e1e4ca1cf2cc tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:33.079772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a1513-ab90-4a45-a0d4-e1e4ca1cf2cc tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:33.138586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08040093511b41c7b7e80bba4b0849cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc4b2b41c9e34e349dd211388130fdf2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:33.139445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:33.139732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:33.140010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] PATH_INFO: `/v3/projects/fabc06c0a08f4f0b9c4d8a2c83e57875` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:33.141185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fabc06c0a08f4f0b9c4d8a2c83e57875)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:33.143384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:33.240374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabc06c0a08f4f0b9c4d8a2c83e57875', 'request_id': 'req-43f5b426-5443-4100-a105-a1ebcdc1e6d3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:33.245726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabc06c0a08f4f0b9c4d8a2c83e57875', 'request_id': 'req-43f5b426-5443-4100-a105-a1ebcdc1e6d3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:33.325044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabc06c0a08f4f0b9c4d8a2c83e57875', 'request_id': 'req-43f5b426-5443-4100-a105-a1ebcdc1e6d3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:33.337820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] The token cache is being invalidate because project fabc06c0a08f4f0b9c4d8a2c83e57875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:33.338117 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:33.338785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:33.340441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1293/2577] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:33 2022] DELETE /identity/v3/projects/fabc06c0a08f4f0b9c4d8a2c83e57875 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:33.343087 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3136372-b01b-442f-b237-9380b474f70b None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:33.343649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3136372-b01b-442f-b237-9380b474f70b None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:33.343649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3136372-b01b-442f-b237-9380b474f70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:33.372848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d3136372-b01b-442f-b237-9380b474f70b None None] MFA Rules not processed for user `b4df001beaca4de2a8e15c26b31a9168`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:33.374423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d3136372-b01b-442f-b237-9380b474f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:33.432837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1285/2578] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:33.468872 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:33.471873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:33.551700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5b426-5443-4100-a105-a1ebcdc1e6d3 tempest-VolumeQuotaClassesTest-1526035748 tempest-VolumeQuotaClassesTest-1526035748-project-admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:33.555475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b57f8a-fe55-4cc7-9aab-bba3ff217525 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f8ec4765e05461a98b3c9eb1d3ced5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:33.556137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b57f8a-fe55-4cc7-9aab-bba3ff217525 service glance] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:33.556422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b57f8a-fe55-4cc7-9aab-bba3ff217525 service glance] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:33.556703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b57f8a-fe55-4cc7-9aab-bba3ff217525 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:33.558732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-15b57f8a-fe55-4cc7-9aab-bba3ff217525 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:33.637971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b57f8a-fe55-4cc7-9aab-bba3ff217525 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:33.639420 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b57f8a-fe55-4cc7-9aab-bba3ff217525 service glance] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:33.653050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1294/2579] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:33.941980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3136372-b01b-442f-b237-9380b474f70b None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:33.943392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d3136372-b01b-442f-b237-9380b474f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:33.993991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b57f8a-fe55-4cc7-9aab-bba3ff217525 service glance] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:33.995910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-15b57f8a-fe55-4cc7-9aab-bba3ff217525 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:34.005115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3136372-b01b-442f-b237-9380b474f70b None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:34.009245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffeb30-1f02-46e7-b1aa-cf20507faf30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:34.009861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffeb30-1f02-46e7-b1aa-cf20507faf30 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:34.010145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffeb30-1f02-46e7-b1aa-cf20507faf30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:34.010421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffeb30-1f02-46e7-b1aa-cf20507faf30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:34.012197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-36ffeb30-1f02-46e7-b1aa-cf20507faf30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:34.022310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffeb30-1f02-46e7-b1aa-cf20507faf30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:34.025372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffeb30-1f02-46e7-b1aa-cf20507faf30 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:34.031828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1286/2580] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:34.064997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b57f8a-fe55-4cc7-9aab-bba3ff217525 service glance] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:34.069805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:34.070718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:34.070999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:34.071279 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] PATH_INFO: `/v3/users/d8f5b51020a942e58a08a6990ea12fe7` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:34.072655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f5b51020a942e58a08a6990ea12fe7)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:34.074641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:34.276750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f5b51020a942e58a08a6990ea12fe7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:34.277453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f5b51020a942e58a08a6990ea12fe7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:34.278224 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f5b51020a942e58a08a6990ea12fe7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:34.290535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f5b51020a942e58a08a6990ea12fe7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:34.299417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f5b51020a942e58a08a6990ea12fe7'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:34.381745 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1295/2581] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:33 2022] DELETE /identity/v3/users/d8f5b51020a942e58a08a6990ea12fe7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:34.386239 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6cc1-7247-49bf-8474-39d01cec1cd6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:34.386732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6cc1-7247-49bf-8474-39d01cec1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:34.386851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b6cc1-7247-49bf-8474-39d01cec1cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:34.404544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1b2b6cc1-7247-49bf-8474-39d01cec1cd6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:34.405746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1b2b6cc1-7247-49bf-8474-39d01cec1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:34.471781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1287/2582] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:34.482219 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:34.484000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:34.554008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ea18e-4f77-45ec-8d9f-d4d14bc68959 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:34.554008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1d703-e9c3-41de-bda9-1d68d357e4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:34.554008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d703-e9c3-41de-bda9-1d68d357e4dc service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:34.554008 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d703-e9c3-41de-bda9-1d68d357e4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:34.554463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d703-e9c3-41de-bda9-1d68d357e4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:34.557217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbcfb8-f8cb-443a-8674-3c5279a4bdfd None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:34.557710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbcfb8-f8cb-443a-8674-3c5279a4bdfd None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:34.558250 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbcfb8-f8cb-443a-8674-3c5279a4bdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:34.562665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1d703-e9c3-41de-bda9-1d68d357e4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:34.564254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1d703-e9c3-41de-bda9-1d68d357e4dc service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:34.574567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1296/2583] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:34.592230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-13fbcfb8-f8cb-443a-8674-3c5279a4bdfd None None] MFA Rules not processed for user `298d03f14c404314a4f142a5b273948a`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:34.593421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-13fbcfb8-f8cb-443a-8674-3c5279a4bdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:34.694079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1288/2584] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:35.069898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1d703-e9c3-41de-bda9-1d68d357e4dc service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:35.071431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b5b1d703-e9c3-41de-bda9-1d68d357e4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:35.087862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1d703-e9c3-41de-bda9-1d68d357e4dc service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:35.094354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:35.095696 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:35.096002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:35.096430 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] PATH_INFO: `/v3/projects/aad22dff041d4d399d0004c0627b44b8` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:35.097635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad22dff041d4d399d0004c0627b44b8)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:35.099550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:35.240317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad22dff041d4d399d0004c0627b44b8', 'request_id': 'req-d1e61096-2225-4c4e-aacd-316dbd12b5fd'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:35.245877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad22dff041d4d399d0004c0627b44b8', 'request_id': 'req-d1e61096-2225-4c4e-aacd-316dbd12b5fd'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:35.336169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad22dff041d4d399d0004c0627b44b8', 'request_id': 'req-d1e61096-2225-4c4e-aacd-316dbd12b5fd'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:35.348108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] The token cache is being invalidate because project aad22dff041d4d399d0004c0627b44b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:35.348394 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:35.349018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:35.353458 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1297/2585] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:35 2022] DELETE /identity/v3/projects/aad22dff041d4d399d0004c0627b44b8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:35.354637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbcfb8-f8cb-443a-8674-3c5279a4bdfd None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:35.367460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbcfb8-f8cb-443a-8674-3c5279a4bdfd None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:35.427786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:35.428672 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:35.428955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:35.429230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] PATH_INFO: `/v3/users/08040093511b41c7b7e80bba4b0849cd` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:35.430497 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08040093511b41c7b7e80bba4b0849cd)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:35.432407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:35.623760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08040093511b41c7b7e80bba4b0849cd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:35.636336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08040093511b41c7b7e80bba4b0849cd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:35.637048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08040093511b41c7b7e80bba4b0849cd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:35.707299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08040093511b41c7b7e80bba4b0849cd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:35.715333 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08040093511b41c7b7e80bba4b0849cd'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:35.722603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1289/2586] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:35 2022] DELETE /identity/v3/users/08040093511b41c7b7e80bba4b0849cd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:36.054467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:36.059326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:36.070194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e61096-2225-4c4e-aacd-316dbd12b5fd admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:36.126495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:36.127540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:36.127884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:36.128182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] PATH_INFO: `/v3/users/7af50709f71b4655b518fdf9bfd15e81` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:36.129455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af50709f71b4655b518fdf9bfd15e81)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:36.131432 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:36.178396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:36.179885 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:36.196030 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dd6cd-6751-4cd3-8503-fb4f7e785735 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:36.203123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:36.203123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:36.203123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:36.203428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] PATH_INFO: `/v3/projects/bc4b2b41c9e34e349dd211388130fdf2` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:36.204791 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4b2b41c9e34e349dd211388130fdf2)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:36.206652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:36.370923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af50709f71b4655b518fdf9bfd15e81'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.371403 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4b2b41c9e34e349dd211388130fdf2', 'request_id': 'req-55c0c214-991c-4e99-8698-0760ce8eec33'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.371746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af50709f71b4655b518fdf9bfd15e81'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.372427 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af50709f71b4655b518fdf9bfd15e81'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.378296 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4b2b41c9e34e349dd211388130fdf2', 'request_id': 'req-55c0c214-991c-4e99-8698-0760ce8eec33'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.386737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af50709f71b4655b518fdf9bfd15e81'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.394395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-da94c5ae-0b6f-49f7-ae42-15168ccb09e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af50709f71b4655b518fdf9bfd15e81'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.461936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4b2b41c9e34e349dd211388130fdf2', 'request_id': 'req-55c0c214-991c-4e99-8698-0760ce8eec33'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.474616 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] The token cache is being invalidate because project bc4b2b41c9e34e349dd211388130fdf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:36.483560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.483560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-55c0c214-991c-4e99-8698-0760ce8eec33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.483560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1290/2587] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:36 2022] DELETE /identity/v3/projects/bc4b2b41c9e34e349dd211388130fdf2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:36.483560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212758f3-4a93-4fe6-b3e0-42d0e622c2a5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:36.483560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212758f3-4a93-4fe6-b3e0-42d0e622c2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:36.483560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212758f3-4a93-4fe6-b3e0-42d0e622c2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:36.503602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-212758f3-4a93-4fe6-b3e0-42d0e622c2a5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:36.504817 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-212758f3-4a93-4fe6-b3e0-42d0e622c2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:36.541563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1298/2588] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:36 2022] DELETE /identity/v3/users/7af50709f71b4655b518fdf9bfd15e81 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:36.566185 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1291/2589] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:36.573958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682cf2-e13a-4a41-ae93-7bac5a02d285 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:36.574254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682cf2-e13a-4a41-ae93-7bac5a02d285 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:36.574540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682cf2-e13a-4a41-ae93-7bac5a02d285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:36.592410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-41682cf2-e13a-4a41-ae93-7bac5a02d285 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:36.593651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-41682cf2-e13a-4a41-ae93-7bac5a02d285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:36.653612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1299/2590] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:36.658843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212758f3-4a93-4fe6-b3e0-42d0e622c2a5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:36.668494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212758f3-4a93-4fe6-b3e0-42d0e622c2a5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:36.674951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2fef7-1c2e-48fe-a800-d5e802f48764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:36.674951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2fef7-1c2e-48fe-a800-d5e802f48764 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:36.675317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2fef7-1c2e-48fe-a800-d5e802f48764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:36.675687 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2fef7-1c2e-48fe-a800-d5e802f48764 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:36.676510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2fef7-1c2e-48fe-a800-d5e802f48764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:15:36.676882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2fef7-1c2e-48fe-a800-d5e802f48764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:36.678595 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2fef7-1c2e-48fe-a800-d5e802f48764 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:36.694245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1292/2591] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:15:36.695362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682cf2-e13a-4a41-ae93-7bac5a02d285 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:36.704934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682cf2-e13a-4a41-ae93-7bac5a02d285 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:36.710184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b3896-551e-4927-ac6e-c82c63f31e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:36.710848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b3896-551e-4927-ac6e-c82c63f31e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:36.711138 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b3896-551e-4927-ac6e-c82c63f31e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:36.711421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b3896-551e-4927-ac6e-c82c63f31e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:36.712167 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b3896-551e-4927-ac6e-c82c63f31e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:36.714126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b3896-551e-4927-ac6e-c82c63f31e8e admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:36.784633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2fef7-1c2e-48fe-a800-d5e802f48764 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:36.789469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-95b2fef7-1c2e-48fe-a800-d5e802f48764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:36.800353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2fef7-1c2e-48fe-a800-d5e802f48764 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:36.805047 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:36.805944 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:36.806241 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:36.806509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] PATH_INFO: `/v3/projects/f69c722ec0a54102b28a9058d1afe077` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:36.807686 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69c722ec0a54102b28a9058d1afe077)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:36.809626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:36.855219 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1300/2592] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:36 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:15:36.856383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b3896-551e-4927-ac6e-c82c63f31e8e admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:36.921308 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b3896-551e-4927-ac6e-c82c63f31e8e admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:36.928167 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28b1a1-3a5a-4490-afbd-0907530d8a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:36.928805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28b1a1-3a5a-4490-afbd-0907530d8a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:36.929150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28b1a1-3a5a-4490-afbd-0907530d8a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:36.929417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28b1a1-3a5a-4490-afbd-0907530d8a55 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:36.930161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28b1a1-3a5a-4490-afbd-0907530d8a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:36.932566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28b1a1-3a5a-4490-afbd-0907530d8a55 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:36.950012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69c722ec0a54102b28a9058d1afe077', 'request_id': 'req-9fd0d440-d247-4c59-b745-7dd629647818'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:36.956602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69c722ec0a54102b28a9058d1afe077', 'request_id': 'req-9fd0d440-d247-4c59-b745-7dd629647818'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.033945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1301/2593] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:36 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:15:37.045086 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28b1a1-3a5a-4490-afbd-0907530d8a55 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:37.045309 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69c722ec0a54102b28a9058d1afe077', 'request_id': 'req-9fd0d440-d247-4c59-b745-7dd629647818'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.048368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28b1a1-3a5a-4490-afbd-0907530d8a55 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:37.052955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] The token cache is being invalidate because project f69c722ec0a54102b28a9058d1afe077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:37.053251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.053941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.055751 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1293/2594] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:36 2022] DELETE /identity/v3/projects/f69c722ec0a54102b28a9058d1afe077 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:37.059497 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:37.060847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:37.109709 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a59236-28a5-4729-9ed0-ce561e18eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:37.110428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a59236-28a5-4729-9ed0-ce561e18eaed admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.110865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a59236-28a5-4729-9ed0-ce561e18eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.111148 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a59236-28a5-4729-9ed0-ce561e18eaed admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.111896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a59236-28a5-4729-9ed0-ce561e18eaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:37.113530 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a59236-28a5-4729-9ed0-ce561e18eaed admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:37.126933 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1302/2595] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:37.128554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a59236-28a5-4729-9ed0-ce561e18eaed admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:37.130405 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-05a59236-28a5-4729-9ed0-ce561e18eaed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:37.131483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0d440-d247-4c59-b745-7dd629647818 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:37.136605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:37.137602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.137884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.138156 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] PATH_INFO: `/v3/users/298d03f14c404314a4f142a5b273948a` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.139373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298d03f14c404314a4f142a5b273948a)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:37.141354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:37.144117 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a59236-28a5-4729-9ed0-ce561e18eaed admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:37.154569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfb376-d1a2-477e-9896-2454e2d13826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:37.154569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfb376-d1a2-477e-9896-2454e2d13826 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.154569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfb376-d1a2-477e-9896-2454e2d13826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.154569 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfb376-d1a2-477e-9896-2454e2d13826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.155142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfb376-d1a2-477e-9896-2454e2d13826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:37.155142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfb376-d1a2-477e-9896-2454e2d13826 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:37.167800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1303/2596] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:37.169298 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfb376-d1a2-477e-9896-2454e2d13826 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:37.187435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfb376-d1a2-477e-9896-2454e2d13826 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:37.193022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000f6b4-3ff4-4925-a826-de8c59d964f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:37.194035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000f6b4-3ff4-4925-a826-de8c59d964f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.194325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000f6b4-3ff4-4925-a826-de8c59d964f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.194597 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000f6b4-3ff4-4925-a826-de8c59d964f1 admin admin] PATH_INFO: `/v3/projects/09df396630174836bb97c810ea9c52b5/users/f188f7a0f6394cfeb202b93e5b61c4bc/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.210413 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000f6b4-3ff4-4925-a826-de8c59d964f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09df396630174836bb97c810ea9c52b5, user_id=f188f7a0f6394cfeb202b93e5b61c4bc, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:37.222462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000f6b4-3ff4-4925-a826-de8c59d964f1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:37.302411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1304/2597] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:37 2022] PUT /identity/v3/projects/09df396630174836bb97c810ea9c52b5/users/f188f7a0f6394cfeb202b93e5b61c4bc/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:37.314676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cfa95-47be-47c4-bd49-de4860d743e3 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.315300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cfa95-47be-47c4-bd49-de4860d743e3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.315743 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cfa95-47be-47c4-bd49-de4860d743e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.343563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-828cfa95-47be-47c4-bd49-de4860d743e3 None None] MFA Rules not processed for user `f188f7a0f6394cfeb202b93e5b61c4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:37.344922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-828cfa95-47be-47c4-bd49-de4860d743e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:37.355853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298d03f14c404314a4f142a5b273948a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.368685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298d03f14c404314a4f142a5b273948a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.369523 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298d03f14c404314a4f142a5b273948a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.416509 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1305/2598] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:37.420916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cfa95-47be-47c4-bd49-de4860d743e3 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:37.444593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298d03f14c404314a4f142a5b273948a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.451695 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298d03f14c404314a4f142a5b273948a'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.458423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1294/2599] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:37 2022] DELETE /identity/v3/users/298d03f14c404314a4f142a5b273948a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:37.485002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cfa95-47be-47c4-bd49-de4860d743e3 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:37.543747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22bb4c-661e-4796-a480-ee6bc8e62482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:37.544421 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22bb4c-661e-4796-a480-ee6bc8e62482 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.544711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22bb4c-661e-4796-a480-ee6bc8e62482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.544994 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22bb4c-661e-4796-a480-ee6bc8e62482 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.545768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22bb4c-661e-4796-a480-ee6bc8e62482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:37.547713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22bb4c-661e-4796-a480-ee6bc8e62482 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:37.641010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1306/2600] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:37 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:37.645977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:37.647682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:37.661986 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec63d5c-023e-482b-b749-dbeb448fc029 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:37.714551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22bb4c-661e-4796-a480-ee6bc8e62482 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:37.716314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9a22bb4c-661e-4796-a480-ee6bc8e62482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:37.717376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f07e7-2f8e-41cf-b24d-4cdb683eaf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:37.718147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f07e7-2f8e-41cf-b24d-4cdb683eaf22 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.718349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f07e7-2f8e-41cf-b24d-4cdb683eaf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.718632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f07e7-2f8e-41cf-b24d-4cdb683eaf22 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.719343 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f07e7-2f8e-41cf-b24d-4cdb683eaf22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:37.722256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f07e7-2f8e-41cf-b24d-4cdb683eaf22 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:37.731270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22bb4c-661e-4796-a480-ee6bc8e62482 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:37.736599 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:37.737515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.737816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.738092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] PATH_INFO: `/v3/projects/b8b0ed9e6f6c491ab37b7013ea23b742` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.739317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b0ed9e6f6c491ab37b7013ea23b742)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:37.741290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:37.801788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1295/2601] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:37 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:37.802879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f07e7-2f8e-41cf-b24d-4cdb683eaf22 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:37.812676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f07e7-2f8e-41cf-b24d-4cdb683eaf22 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:37.817599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618d42c-08c8-4c82-aaf9-58975de275a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:37.818267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d42c-08c8-4c82-aaf9-58975de275a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.818548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d42c-08c8-4c82-aaf9-58975de275a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.818812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d42c-08c8-4c82-aaf9-58975de275a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.819538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618d42c-08c8-4c82-aaf9-58975de275a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:37.821161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618d42c-08c8-4c82-aaf9-58975de275a9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:37.832097 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1296/2602] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:37.836383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618d42c-08c8-4c82-aaf9-58975de275a9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:37.846861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618d42c-08c8-4c82-aaf9-58975de275a9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:37.851561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b272-8f61-4a2f-a42a-39dd7a7602c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:37.852429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b272-8f61-4a2f-a42a-39dd7a7602c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.852721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b272-8f61-4a2f-a42a-39dd7a7602c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.853001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b272-8f61-4a2f-a42a-39dd7a7602c0 admin admin] PATH_INFO: `/v3/projects/8a313605457241cca85ecb95baa6b119/users/98b6d62707514080b4c125b65c628d32/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.867973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7b272-8f61-4a2f-a42a-39dd7a7602c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a313605457241cca85ecb95baa6b119, user_id=98b6d62707514080b4c125b65c628d32, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:37.870672 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7b272-8f61-4a2f-a42a-39dd7a7602c0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:37.871983 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b0ed9e6f6c491ab37b7013ea23b742', 'request_id': 'req-e2474dde-ab92-44d3-8c65-624e03e127f1'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.878108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b0ed9e6f6c491ab37b7013ea23b742', 'request_id': 'req-e2474dde-ab92-44d3-8c65-624e03e127f1'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.930705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1297/2603] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:37 2022] PUT /identity/v3/projects/8a313605457241cca85ecb95baa6b119/users/98b6d62707514080b4c125b65c628d32/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:37.934633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b272-8f61-4a2f-a42a-39dd7a7602c0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:37.941498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b0ed9e6f6c491ab37b7013ea23b742', 'request_id': 'req-e2474dde-ab92-44d3-8c65-624e03e127f1'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.957329 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] The token cache is being invalidate because project b8b0ed9e6f6c491ab37b7013ea23b742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:37.957682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.958548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e2474dde-ab92-44d3-8c65-624e03e127f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:37.960386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1307/2604] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:37 2022] DELETE /identity/v3/projects/b8b0ed9e6f6c491ab37b7013ea23b742 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:37.966162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e97cb-c614-4b2c-97d3-589405ef4845 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:37.966540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e97cb-c614-4b2c-97d3-589405ef4845 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:37.967035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e97cb-c614-4b2c-97d3-589405ef4845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:37.994866 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-554e97cb-c614-4b2c-97d3-589405ef4845 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:37.996353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-554e97cb-c614-4b2c-97d3-589405ef4845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:38.011049 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b272-8f61-4a2f-a42a-39dd7a7602c0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.016038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf14d0-4d96-41d9-b648-84377cd18c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.017395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf14d0-4d96-41d9-b648-84377cd18c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.017657 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf14d0-4d96-41d9-b648-84377cd18c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.017944 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf14d0-4d96-41d9-b648-84377cd18c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.018680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf14d0-4d96-41d9-b648-84377cd18c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.020335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf14d0-4d96-41d9-b648-84377cd18c64 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.030429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1298/2605] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:38.035928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf14d0-4d96-41d9-b648-84377cd18c64 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.037853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-aabf14d0-4d96-41d9-b648-84377cd18c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:38.050704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf14d0-4d96-41d9-b648-84377cd18c64 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.055493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2561292-66d9-451f-ba50-d7ac11675bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.056370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2561292-66d9-451f-ba50-d7ac11675bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.056657 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2561292-66d9-451f-ba50-d7ac11675bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.056941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2561292-66d9-451f-ba50-d7ac11675bce admin admin] PATH_INFO: `/v3/projects/8a313605457241cca85ecb95baa6b119/users/98b6d62707514080b4c125b65c628d32/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.058916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2561292-66d9-451f-ba50-d7ac11675bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a313605457241cca85ecb95baa6b119, user_id=98b6d62707514080b4c125b65c628d32, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.060332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1308/2606] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:38.061615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2561292-66d9-451f-ba50-d7ac11675bce admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.068613 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd5fc-5541-4eaf-ad6d-3e16bd4a27bf None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.068903 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd5fc-5541-4eaf-ad6d-3e16bd4a27bf None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.069181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdd5fc-5541-4eaf-ad6d-3e16bd4a27bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.080174 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1299/2607] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:38 2022] PUT /identity/v3/projects/8a313605457241cca85ecb95baa6b119/users/98b6d62707514080b4c125b65c628d32/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:38.089061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a3bdd5fc-5541-4eaf-ad6d-3e16bd4a27bf None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:38.090316 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a3bdd5fc-5541-4eaf-ad6d-3e16bd4a27bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:38.092135 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57625ae-f1ea-4e9c-8f46-1250d89ca3a2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.092428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57625ae-f1ea-4e9c-8f46-1250d89ca3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.092726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57625ae-f1ea-4e9c-8f46-1250d89ca3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.121002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e57625ae-f1ea-4e9c-8f46-1250d89ca3a2 None None] MFA Rules not processed for user `98b6d62707514080b4c125b65c628d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:38.122243 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e57625ae-f1ea-4e9c-8f46-1250d89ca3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:38.149766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1309/2608] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:38.154057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd5fc-5541-4eaf-ad6d-3e16bd4a27bf None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.163510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdd5fc-5541-4eaf-ad6d-3e16bd4a27bf None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.168393 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7acc73-bf15-47b7-b885-8c9818c6cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.169077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7acc73-bf15-47b7-b885-8c9818c6cde2 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.169392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7acc73-bf15-47b7-b885-8c9818c6cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.169680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7acc73-bf15-47b7-b885-8c9818c6cde2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.170418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7acc73-bf15-47b7-b885-8c9818c6cde2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:15:38.170730 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7acc73-bf15-47b7-b885-8c9818c6cde2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.172371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7acc73-bf15-47b7-b885-8c9818c6cde2 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.184648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1310/2609] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 21:15:38.189535 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7acc73-bf15-47b7-b885-8c9818c6cde2 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.197575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1300/2610] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:38.199488 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7acc73-bf15-47b7-b885-8c9818c6cde2 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.205353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd9f59-3ea6-4b45-b499-11624bec444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.206006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd9f59-3ea6-4b45-b499-11624bec444c admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.206295 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd9f59-3ea6-4b45-b499-11624bec444c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.206583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd9f59-3ea6-4b45-b499-11624bec444c admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.207283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd9f59-3ea6-4b45-b499-11624bec444c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.209265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd9f59-3ea6-4b45-b499-11624bec444c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.209901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57625ae-f1ea-4e9c-8f46-1250d89ca3a2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.211393 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e57625ae-f1ea-4e9c-8f46-1250d89ca3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:38.276496 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57625ae-f1ea-4e9c-8f46-1250d89ca3a2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.280261 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741fa0d-0ec9-4a55-a882-86399994b898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.280922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741fa0d-0ec9-4a55-a882-86399994b898 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.281212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741fa0d-0ec9-4a55-a882-86399994b898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.281528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741fa0d-0ec9-4a55-a882-86399994b898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.291260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741fa0d-0ec9-4a55-a882-86399994b898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.292752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741fa0d-0ec9-4a55-a882-86399994b898 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.303232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1301/2611] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:15:38.317725 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1311/2612] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:38 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:15:38.321821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741fa0d-0ec9-4a55-a882-86399994b898 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.333713 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741fa0d-0ec9-4a55-a882-86399994b898 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.395776 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd14d40-3a81-4e84-968e-493111145ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.396807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14d40-3a81-4e84-968e-493111145ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.397091 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14d40-3a81-4e84-968e-493111145ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.397410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14d40-3a81-4e84-968e-493111145ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.398108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd14d40-3a81-4e84-968e-493111145ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.400050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd14d40-3a81-4e84-968e-493111145ec8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.455649 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd9f59-3ea6-4b45-b499-11624bec444c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.492318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1302/2613] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:38 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:38.496988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd14d40-3a81-4e84-968e-493111145ec8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.507045 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd14d40-3a81-4e84-968e-493111145ec8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.511995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794da03-4fe1-4439-8026-70a3909a40f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.512773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794da03-4fe1-4439-8026-70a3909a40f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.513064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794da03-4fe1-4439-8026-70a3909a40f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.513382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794da03-4fe1-4439-8026-70a3909a40f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.514220 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794da03-4fe1-4439-8026-70a3909a40f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.514433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd9f59-3ea6-4b45-b499-11624bec444c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.515749 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794da03-4fe1-4439-8026-70a3909a40f4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.519631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ea608-7cf7-4731-8fc8-ec836eb95d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.520414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea608-7cf7-4731-8fc8-ec836eb95d94 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.520704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea608-7cf7-4731-8fc8-ec836eb95d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.521429 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea608-7cf7-4731-8fc8-ec836eb95d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.523389 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f26ea608-7cf7-4731-8fc8-ec836eb95d94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:38.529482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1303/2614] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:38.534524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794da03-4fe1-4439-8026-70a3909a40f4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.544590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794da03-4fe1-4439-8026-70a3909a40f4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.550017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73f0e-dbce-448c-ad07-719ef6ce18dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.552310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73f0e-dbce-448c-ad07-719ef6ce18dd admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.552310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73f0e-dbce-448c-ad07-719ef6ce18dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.552310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73f0e-dbce-448c-ad07-719ef6ce18dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.552310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d73f0e-dbce-448c-ad07-719ef6ce18dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.553594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d73f0e-dbce-448c-ad07-719ef6ce18dd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.565310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1304/2615] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:38.569430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73f0e-dbce-448c-ad07-719ef6ce18dd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.579940 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73f0e-dbce-448c-ad07-719ef6ce18dd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.584514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ea608-7cf7-4731-8fc8-ec836eb95d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.585305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16ee9e-f60a-49f5-b0a1-5a65083ffb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.586066 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ea608-7cf7-4731-8fc8-ec836eb95d94 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.586467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16ee9e-f60a-49f5-b0a1-5a65083ffb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.586748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16ee9e-f60a-49f5-b0a1-5a65083ffb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.587027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16ee9e-f60a-49f5-b0a1-5a65083ffb1a admin admin] PATH_INFO: `/v3/projects/7a8f38f5523344b1a1d2a8e55a0601a3/users/78a4e7ed2771432bb3e5775fe04f6a6b/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.600640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1312/2616] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:15:38.607520 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16ee9e-f60a-49f5-b0a1-5a65083ffb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8f38f5523344b1a1d2a8e55a0601a3, user_id=78a4e7ed2771432bb3e5775fe04f6a6b, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.609406 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16ee9e-f60a-49f5-b0a1-5a65083ffb1a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.672161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1305/2617] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:38 2022] PUT /identity/v3/projects/7a8f38f5523344b1a1d2a8e55a0601a3/users/78a4e7ed2771432bb3e5775fe04f6a6b/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:38.685124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568de138-6d2f-40dd-9cb4-b620ce8933aa None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.685454 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568de138-6d2f-40dd-9cb4-b620ce8933aa None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.685741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568de138-6d2f-40dd-9cb4-b620ce8933aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.718371 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-568de138-6d2f-40dd-9cb4-b620ce8933aa None None] MFA Rules not processed for user `78a4e7ed2771432bb3e5775fe04f6a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:38.720929 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-568de138-6d2f-40dd-9cb4-b620ce8933aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:38.802288 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1313/2618] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:38.806961 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16ee9e-f60a-49f5-b0a1-5a65083ffb1a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.870815 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16ee9e-f60a-49f5-b0a1-5a65083ffb1a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:38.876652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9d60b-4a97-4863-bb4e-1c00963e9ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:38.877604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9d60b-4a97-4863-bb4e-1c00963e9ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:38.878030 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9d60b-4a97-4863-bb4e-1c00963e9ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:38.878202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9d60b-4a97-4863-bb4e-1c00963e9ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:38.878978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9d60b-4a97-4863-bb4e-1c00963e9ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:38.880916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9d60b-4a97-4863-bb4e-1c00963e9ebb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:38.964991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1306/2619] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:38 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:15:38.966173 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568de138-6d2f-40dd-9cb4-b620ce8933aa None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:38.977059 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568de138-6d2f-40dd-9cb4-b620ce8933aa None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:39.040422 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71724ba-8e29-4d28-90ed-d3fe96732308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:39.041019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71724ba-8e29-4d28-90ed-d3fe96732308 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.041330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71724ba-8e29-4d28-90ed-d3fe96732308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.041612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71724ba-8e29-4d28-90ed-d3fe96732308 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.042324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71724ba-8e29-4d28-90ed-d3fe96732308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:39.044408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71724ba-8e29-4d28-90ed-d3fe96732308 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:39.069495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9d60b-4a97-4863-bb4e-1c00963e9ebb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:39.080884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9d60b-4a97-4863-bb4e-1c00963e9ebb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:39.085559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:39.086527 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.089590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.089590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] PATH_INFO: `/v3/users/f188f7a0f6394cfeb202b93e5b61c4bc` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.089590 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f188f7a0f6394cfeb202b93e5b61c4bc)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:39.090903 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:39.143375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1314/2620] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:38 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:39.147364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71724ba-8e29-4d28-90ed-d3fe96732308 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:39.156580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71724ba-8e29-4d28-90ed-d3fe96732308 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:39.161904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa3ffe-9998-49fc-8f05-cf0e96322698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:39.162596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa3ffe-9998-49fc-8f05-cf0e96322698 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.162883 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa3ffe-9998-49fc-8f05-cf0e96322698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.163187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa3ffe-9998-49fc-8f05-cf0e96322698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.163967 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa3ffe-9998-49fc-8f05-cf0e96322698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:39.165594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa3ffe-9998-49fc-8f05-cf0e96322698 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:39.176304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1315/2621] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:39.180280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa3ffe-9998-49fc-8f05-cf0e96322698 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:39.191055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa3ffe-9998-49fc-8f05-cf0e96322698 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:39.195751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4531be-b58c-413a-9cc2-d1386f2ddc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:39.196665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4531be-b58c-413a-9cc2-d1386f2ddc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.196953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4531be-b58c-413a-9cc2-d1386f2ddc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.197316 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4531be-b58c-413a-9cc2-d1386f2ddc39 admin admin] PATH_INFO: `/v3/projects/d70c24bb454943b2ac702d7746d0c931/users/6fdcd65cdf374b19a05c8d2733eac98d/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.212142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4531be-b58c-413a-9cc2-d1386f2ddc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70c24bb454943b2ac702d7746d0c931, user_id=6fdcd65cdf374b19a05c8d2733eac98d, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:39.214849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4531be-b58c-413a-9cc2-d1386f2ddc39 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:39.278944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1316/2622] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:39 2022] PUT /identity/v3/projects/d70c24bb454943b2ac702d7746d0c931/users/6fdcd65cdf374b19a05c8d2733eac98d/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:39.281940 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f188f7a0f6394cfeb202b93e5b61c4bc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:39.282732 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4531be-b58c-413a-9cc2-d1386f2ddc39 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:39.293990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f188f7a0f6394cfeb202b93e5b61c4bc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:39.294660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f188f7a0f6394cfeb202b93e5b61c4bc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:39.343477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4531be-b58c-413a-9cc2-d1386f2ddc39 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:39.347667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f188f7a0f6394cfeb202b93e5b61c4bc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:39.348493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853985-c74d-484d-b641-a7f119189bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:39.349165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853985-c74d-484d-b641-a7f119189bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.349484 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853985-c74d-484d-b641-a7f119189bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.349771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853985-c74d-484d-b641-a7f119189bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.350497 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853985-c74d-484d-b641-a7f119189bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:39.352121 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853985-c74d-484d-b641-a7f119189bc1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:39.355008 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-3f450f2c-11e9-45a0-af86-1f68bf7288e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f188f7a0f6394cfeb202b93e5b61c4bc'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:39.362038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1307/2623] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:39 2022] DELETE /identity/v3/users/f188f7a0f6394cfeb202b93e5b61c4bc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:39.368570 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1317/2624] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:39.368718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e0ba3-5c61-4ba6-ac3e-67f423a3a3e2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.368718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e0ba3-5c61-4ba6-ac3e-67f423a3a3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.368718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e0ba3-5c61-4ba6-ac3e-67f423a3a3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.369037 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853985-c74d-484d-b641-a7f119189bc1 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:39.369232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-51853985-c74d-484d-b641-a7f119189bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:39.383018 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853985-c74d-484d-b641-a7f119189bc1 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:39.386926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e07e0ba3-5c61-4ba6-ac3e-67f423a3a3e2 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:39.388007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e07e0ba3-5c61-4ba6-ac3e-67f423a3a3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:39.442618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9116-b0e1-4bb2-aea8-b23b675727fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:39.443713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9116-b0e1-4bb2-aea8-b23b675727fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.444004 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9116-b0e1-4bb2-aea8-b23b675727fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.444289 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9116-b0e1-4bb2-aea8-b23b675727fd admin admin] PATH_INFO: `/v3/projects/d70c24bb454943b2ac702d7746d0c931/users/6fdcd65cdf374b19a05c8d2733eac98d/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.446304 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9116-b0e1-4bb2-aea8-b23b675727fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70c24bb454943b2ac702d7746d0c931, user_id=6fdcd65cdf374b19a05c8d2733eac98d, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:39.448963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9116-b0e1-4bb2-aea8-b23b675727fd admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:39.449311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1308/2625] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:39.459328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1318/2626] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:39 2022] PUT /identity/v3/projects/d70c24bb454943b2ac702d7746d0c931/users/6fdcd65cdf374b19a05c8d2733eac98d/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:39.459684 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e0ba3-5c61-4ba6-ac3e-67f423a3a3e2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:39.461103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e07e0ba3-5c61-4ba6-ac3e-67f423a3a3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:39.470582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f899b-02a7-43c1-b046-3d4713ef57d1 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.470872 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f899b-02a7-43c1-b046-3d4713ef57d1 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.471171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f899b-02a7-43c1-b046-3d4713ef57d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.497247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-bd3f899b-02a7-43c1-b046-3d4713ef57d1 None None] MFA Rules not processed for user `6fdcd65cdf374b19a05c8d2733eac98d`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:39.498485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bd3f899b-02a7-43c1-b046-3d4713ef57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:39.517937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e0ba3-5c61-4ba6-ac3e-67f423a3a3e2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:39.566114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72602994-1e7b-4043-9d47-bad1fbcbff62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:39.566714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72602994-1e7b-4043-9d47-bad1fbcbff62 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.567013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72602994-1e7b-4043-9d47-bad1fbcbff62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.567286 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72602994-1e7b-4043-9d47-bad1fbcbff62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.568618 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1319/2627] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:39.579944 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f899b-02a7-43c1-b046-3d4713ef57d1 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:39.581359 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-bd3f899b-02a7-43c1-b046-3d4713ef57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:39.628641 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72602994-1e7b-4043-9d47-bad1fbcbff62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:39.630110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72602994-1e7b-4043-9d47-bad1fbcbff62 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:39.636708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f899b-02a7-43c1-b046-3d4713ef57d1 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:39.639582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1309/2628] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:15:39.640365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b35a6-cd7e-4a01-ae8c-1d30f5008c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:39.641093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b35a6-cd7e-4a01-ae8c-1d30f5008c0c service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.641481 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b35a6-cd7e-4a01-ae8c-1d30f5008c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.641798 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b35a6-cd7e-4a01-ae8c-1d30f5008c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.651566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b35a6-cd7e-4a01-ae8c-1d30f5008c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:39.653013 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b35a6-cd7e-4a01-ae8c-1d30f5008c0c service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:39.663540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1320/2629] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:39.916789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72602994-1e7b-4043-9d47-bad1fbcbff62 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:39.918323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-72602994-1e7b-4043-9d47-bad1fbcbff62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:39.933639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72602994-1e7b-4043-9d47-bad1fbcbff62 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:39.937391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a471d7-70b3-48c6-8174-18c3a1773926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:39.938260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a471d7-70b3-48c6-8174-18c3a1773926 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:39.939326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a471d7-70b3-48c6-8174-18c3a1773926 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:39.939705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a471d7-70b3-48c6-8174-18c3a1773926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:39.942152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e5a471d7-70b3-48c6-8174-18c3a1773926 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:40.004916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a471d7-70b3-48c6-8174-18c3a1773926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:40.006537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a471d7-70b3-48c6-8174-18c3a1773926 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:40.015597 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1310/2630] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:40.053135 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b35a6-cd7e-4a01-ae8c-1d30f5008c0c service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:40.054625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-219b35a6-cd7e-4a01-ae8c-1d30f5008c0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:40.071174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b35a6-cd7e-4a01-ae8c-1d30f5008c0c service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:40.076450 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:40.077862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:40.078007 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:40.078282 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] PATH_INFO: `/v3/projects/09df396630174836bb97c810ea9c52b5` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:40.080571 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09df396630174836bb97c810ea9c52b5)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:40.082612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:40.198527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09df396630174836bb97c810ea9c52b5', 'request_id': 'req-e39660fd-c171-43df-afb8-e79e7b241a75'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:40.204697 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09df396630174836bb97c810ea9c52b5', 'request_id': 'req-e39660fd-c171-43df-afb8-e79e7b241a75'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:40.257835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09df396630174836bb97c810ea9c52b5', 'request_id': 'req-e39660fd-c171-43df-afb8-e79e7b241a75'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:40.271424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] The token cache is being invalidate because project 09df396630174836bb97c810ea9c52b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:40.271726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:40.272479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:40.274391 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1321/2631] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:40 2022] DELETE /identity/v3/projects/09df396630174836bb97c810ea9c52b5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:40.279051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a471d7-70b3-48c6-8174-18c3a1773926 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:40.293079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a471d7-70b3-48c6-8174-18c3a1773926 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:40.363837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:40.364721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:40.365007 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:40.365364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] PATH_INFO: `/v3/users/98b6d62707514080b4c125b65c628d32` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:40.366662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b6d62707514080b4c125b65c628d32)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:40.368616 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:40.630354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b6d62707514080b4c125b65c628d32'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:40.642562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b6d62707514080b4c125b65c628d32'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:40.643125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b6d62707514080b4c125b65c628d32'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:40.702043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b6d62707514080b4c125b65c628d32'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:40.709623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a2ecd5c-b23a-4c3f-a5d3-d36b56759e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b6d62707514080b4c125b65c628d32'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:40.715376 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1311/2632] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:40 2022] DELETE /identity/v3/users/98b6d62707514080b4c125b65c628d32 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:41.091802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:41.093806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:41.109312 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39660fd-c171-43df-afb8-e79e7b241a75 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:41.168268 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:41.169049 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:41.169362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:41.169638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] PATH_INFO: `/v3/projects/8a313605457241cca85ecb95baa6b119` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:41.170895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a313605457241cca85ecb95baa6b119)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:41.172911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:41.261607 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a313605457241cca85ecb95baa6b119', 'request_id': 'req-2ecef02e-20db-498d-aca4-867d57ee308d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:41.267322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a313605457241cca85ecb95baa6b119', 'request_id': 'req-2ecef02e-20db-498d-aca4-867d57ee308d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:41.324230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a313605457241cca85ecb95baa6b119', 'request_id': 'req-2ecef02e-20db-498d-aca4-867d57ee308d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:41.336254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] The token cache is being invalidate because project 8a313605457241cca85ecb95baa6b119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:41.336539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:41.337205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2ecef02e-20db-498d-aca4-867d57ee308d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:41.338763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1322/2633] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:41 2022] DELETE /identity/v3/projects/8a313605457241cca85ecb95baa6b119 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:41.343678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb84e8-b3fc-43bf-b0eb-d4e896223dbf None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:41.344184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb84e8-b3fc-43bf-b0eb-d4e896223dbf None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:41.344305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb84e8-b3fc-43bf-b0eb-d4e896223dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:41.363075 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-aafb84e8-b3fc-43bf-b0eb-d4e896223dbf None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:41.364299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-aafb84e8-b3fc-43bf-b0eb-d4e896223dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:41.420950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1312/2634] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:41.429384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402ab2-5c61-45bf-848f-c5f8d6b9d6eb None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:41.429675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402ab2-5c61-45bf-848f-c5f8d6b9d6eb None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:41.429981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402ab2-5c61-45bf-848f-c5f8d6b9d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:41.450888 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-2c402ab2-5c61-45bf-848f-c5f8d6b9d6eb None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:41.452300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-2c402ab2-5c61-45bf-848f-c5f8d6b9d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:41.460768 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1323/2635] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:41.465695 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb84e8-b3fc-43bf-b0eb-d4e896223dbf None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:41.476653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb84e8-b3fc-43bf-b0eb-d4e896223dbf None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:41.481126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b09b3-63dc-4155-b4fa-807a1088c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:41.481828 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b09b3-63dc-4155-b4fa-807a1088c4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:41.482111 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b09b3-63dc-4155-b4fa-807a1088c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:41.482388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b09b3-63dc-4155-b4fa-807a1088c4fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:41.483114 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b09b3-63dc-4155-b4fa-807a1088c4fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:15:41.483450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b09b3-63dc-4155-b4fa-807a1088c4fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:41.485018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b09b3-63dc-4155-b4fa-807a1088c4fb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:41.496886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1313/2636] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:15:41.501688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402ab2-5c61-45bf-848f-c5f8d6b9d6eb None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:41.510577 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402ab2-5c61-45bf-848f-c5f8d6b9d6eb None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:41.515187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab503a5-9e74-43b6-aca1-b8a0c48284b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:41.515828 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab503a5-9e74-43b6-aca1-b8a0c48284b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:41.516112 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab503a5-9e74-43b6-aca1-b8a0c48284b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:41.516906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab503a5-9e74-43b6-aca1-b8a0c48284b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:41.518058 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab503a5-9e74-43b6-aca1-b8a0c48284b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:41.519949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab503a5-9e74-43b6-aca1-b8a0c48284b5 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:41.605920 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1324/2637] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:41 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:41.611797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b09b3-63dc-4155-b4fa-807a1088c4fb admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:41.621874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b09b3-63dc-4155-b4fa-807a1088c4fb admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:41.677738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85669-1c84-4543-8d69-ec9478e65860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:41.678488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85669-1c84-4543-8d69-ec9478e65860 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:41.678610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85669-1c84-4543-8d69-ec9478e65860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:41.678869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85669-1c84-4543-8d69-ec9478e65860 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:41.682207 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f85669-1c84-4543-8d69-ec9478e65860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:41.682207 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f85669-1c84-4543-8d69-ec9478e65860 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:41.782249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1314/2638] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:41 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:41.786395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab503a5-9e74-43b6-aca1-b8a0c48284b5 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:41.796988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab503a5-9e74-43b6-aca1-b8a0c48284b5 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:41.803284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b44e7-a17b-4051-b9e2-07e7dbe40e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:41.803284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b44e7-a17b-4051-b9e2-07e7dbe40e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:41.803536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b44e7-a17b-4051-b9e2-07e7dbe40e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:41.803786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b44e7-a17b-4051-b9e2-07e7dbe40e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:41.804579 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b44e7-a17b-4051-b9e2-07e7dbe40e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:41.806228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b44e7-a17b-4051-b9e2-07e7dbe40e57 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:41.818786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1325/2639] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:41.822434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85669-1c84-4543-8d69-ec9478e65860 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:41.832253 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85669-1c84-4543-8d69-ec9478e65860 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:41.837011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b1e58-6204-448a-b4bd-13d855a9b800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:41.837835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b1e58-6204-448a-b4bd-13d855a9b800 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:41.838189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b1e58-6204-448a-b4bd-13d855a9b800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:41.838540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b1e58-6204-448a-b4bd-13d855a9b800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:41.839340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b1e58-6204-448a-b4bd-13d855a9b800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:41.841268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b1e58-6204-448a-b4bd-13d855a9b800 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:41.853446 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1315/2640] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:41.857760 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b44e7-a17b-4051-b9e2-07e7dbe40e57 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:41.869169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b44e7-a17b-4051-b9e2-07e7dbe40e57 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:41.873996 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc38be1-ed0d-4001-96fc-71135a02b3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:41.874870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc38be1-ed0d-4001-96fc-71135a02b3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:41.875150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc38be1-ed0d-4001-96fc-71135a02b3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:41.875424 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc38be1-ed0d-4001-96fc-71135a02b3cd admin admin] PATH_INFO: `/v3/projects/8622fd304ec04eefb111dad635939487/users/ac4d83e459a841f3ba28dfa6c4378846/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:41.890746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc38be1-ed0d-4001-96fc-71135a02b3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8622fd304ec04eefb111dad635939487, user_id=ac4d83e459a841f3ba28dfa6c4378846, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:41.893802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc38be1-ed0d-4001-96fc-71135a02b3cd admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:41.965103 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1326/2641] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:41 2022] PUT /identity/v3/projects/8622fd304ec04eefb111dad635939487/users/ac4d83e459a841f3ba28dfa6c4378846/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:41.980475 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a09581-0237-4ae6-977f-d9df8b9b9273 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:41.980773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a09581-0237-4ae6-977f-d9df8b9b9273 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:41.981060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a09581-0237-4ae6-977f-d9df8b9b9273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:42.008609 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-61a09581-0237-4ae6-977f-d9df8b9b9273 None None] MFA Rules not processed for user `ac4d83e459a841f3ba28dfa6c4378846`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:42.009875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-61a09581-0237-4ae6-977f-d9df8b9b9273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:42.085824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1316/2642] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:42.098241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc38be1-ed0d-4001-96fc-71135a02b3cd admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:42.100146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9dc38be1-ed0d-4001-96fc-71135a02b3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:42.159652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc38be1-ed0d-4001-96fc-71135a02b3cd admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:42.163315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0f01c-6601-49b6-af0c-6254ba94a7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:42.163961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0f01c-6601-49b6-af0c-6254ba94a7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:42.164245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0f01c-6601-49b6-af0c-6254ba94a7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:42.164524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0f01c-6601-49b6-af0c-6254ba94a7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:42.174074 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0f01c-6601-49b6-af0c-6254ba94a7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:42.175583 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0f01c-6601-49b6-af0c-6254ba94a7c0 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:42.184942 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1327/2643] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:43.539173 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a09581-0237-4ae6-977f-d9df8b9b9273 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:43.540573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-61a09581-0237-4ae6-977f-d9df8b9b9273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:43.603256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a09581-0237-4ae6-977f-d9df8b9b9273 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:43.607781 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:43.608646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:43.608927 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:43.609202 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] PATH_INFO: `/v3/users/78a4e7ed2771432bb3e5775fe04f6a6b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:43.610414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a4e7ed2771432bb3e5775fe04f6a6b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:43.612318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:43.777400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a4e7ed2771432bb3e5775fe04f6a6b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:43.789152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a4e7ed2771432bb3e5775fe04f6a6b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:43.790499 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a4e7ed2771432bb3e5775fe04f6a6b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:43.850079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a4e7ed2771432bb3e5775fe04f6a6b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:43.857707 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a4e7ed2771432bb3e5775fe04f6a6b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:43.865157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1317/2644] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:43 2022] DELETE /identity/v3/users/78a4e7ed2771432bb3e5775fe04f6a6b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:43.869634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2164a-524c-4c51-a450-e3b173768826 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:43.870057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2164a-524c-4c51-a450-e3b173768826 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:43.870233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2164a-524c-4c51-a450-e3b173768826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:43.888208 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-cfd2164a-524c-4c51-a450-e3b173768826 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:43.889418 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-cfd2164a-524c-4c51-a450-e3b173768826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:43.951090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1328/2645] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:43.961760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:43.963147 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:44.020977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aaa05-e7a5-465a-82d0-cb2caa927311 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:44.024950 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00444e2c-6b0e-44e4-a959-bc6bf8719ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:44.025656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444e2c-6b0e-44e4-a959-bc6bf8719ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:44.026123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444e2c-6b0e-44e4-a959-bc6bf8719ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:44.026405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444e2c-6b0e-44e4-a959-bc6bf8719ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:44.036526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00444e2c-6b0e-44e4-a959-bc6bf8719ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:44.037990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00444e2c-6b0e-44e4-a959-bc6bf8719ea0 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:44.047654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1318/2646] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:44.486726 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2164a-524c-4c51-a450-e3b173768826 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:44.488142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-cfd2164a-524c-4c51-a450-e3b173768826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:44.500262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2164a-524c-4c51-a450-e3b173768826 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:44.505904 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:44.506790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:44.507073 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:44.507351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] PATH_INFO: `/v3/projects/7a8f38f5523344b1a1d2a8e55a0601a3` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:44.508624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8f38f5523344b1a1d2a8e55a0601a3)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:44.510632 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:44.628093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8f38f5523344b1a1d2a8e55a0601a3', 'request_id': 'req-5c808512-ad40-433b-b99d-05245451c9e4'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:44.633062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8f38f5523344b1a1d2a8e55a0601a3', 'request_id': 'req-5c808512-ad40-433b-b99d-05245451c9e4'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:44.684428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8f38f5523344b1a1d2a8e55a0601a3', 'request_id': 'req-5c808512-ad40-433b-b99d-05245451c9e4'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:44.696262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] The token cache is being invalidate because project 7a8f38f5523344b1a1d2a8e55a0601a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:44.702062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:44.702062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:44.702062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1329/2647] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:44 2022] DELETE /identity/v3/projects/7a8f38f5523344b1a1d2a8e55a0601a3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:44.703886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00444e2c-6b0e-44e4-a959-bc6bf8719ea0 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:44.714394 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00444e2c-6b0e-44e4-a959-bc6bf8719ea0 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:44.774247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:44.775125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:44.775413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:44.775696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] PATH_INFO: `/v3/users/6fdcd65cdf374b19a05c8d2733eac98d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:44.776890 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdcd65cdf374b19a05c8d2733eac98d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:44.778840 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:44.908897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdcd65cdf374b19a05c8d2733eac98d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:44.921506 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdcd65cdf374b19a05c8d2733eac98d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:44.922208 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdcd65cdf374b19a05c8d2733eac98d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:44.964172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdcd65cdf374b19a05c8d2733eac98d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:44.970956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1647f5b4-21c4-4722-aacb-bf3223666eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdcd65cdf374b19a05c8d2733eac98d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:44.977635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1319/2648] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:44 2022] DELETE /identity/v3/users/6fdcd65cdf374b19a05c8d2733eac98d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:45.354640 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:45.356306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:45.373455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808512-ad40-433b-b99d-05245451c9e4 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:45.440065 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:45.441630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:45.441919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:45.442245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] PATH_INFO: `/v3/projects/d70c24bb454943b2ac702d7746d0c931` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:45.443447 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70c24bb454943b2ac702d7746d0c931)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:45.445428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:45.543522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70c24bb454943b2ac702d7746d0c931', 'request_id': 'req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:45.548740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70c24bb454943b2ac702d7746d0c931', 'request_id': 'req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:45.633411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70c24bb454943b2ac702d7746d0c931', 'request_id': 'req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:45.650661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] The token cache is being invalidate because project d70c24bb454943b2ac702d7746d0c931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:45.650959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:45.651621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-99f5e2b0-923b-4e9a-ade9-d9eefbe2ad13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:45.653184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1330/2649] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:45 2022] DELETE /identity/v3/projects/d70c24bb454943b2ac702d7746d0c931 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:45.658272 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5847d-d00b-480d-bf50-85dddb3040a6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:45.658564 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5847d-d00b-480d-bf50-85dddb3040a6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:45.658846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5847d-d00b-480d-bf50-85dddb3040a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:45.680238 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-55b5847d-d00b-480d-bf50-85dddb3040a6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:45.681495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-55b5847d-d00b-480d-bf50-85dddb3040a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:45.739016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1320/2650] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:45.746918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5613e-8084-4897-95dd-80b8c1715475 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:45.747238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5613e-8084-4897-95dd-80b8c1715475 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:45.747527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5613e-8084-4897-95dd-80b8c1715475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:45.765938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-15a5613e-8084-4897-95dd-80b8c1715475 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:45.772841 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-15a5613e-8084-4897-95dd-80b8c1715475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:45.781083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1331/2651] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:45.786143 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5847d-d00b-480d-bf50-85dddb3040a6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:45.796113 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5847d-d00b-480d-bf50-85dddb3040a6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:45.801826 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c7b24-ee9c-4b58-bcd6-470a22da279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:45.802503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c7b24-ee9c-4b58-bcd6-470a22da279c admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:45.802789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c7b24-ee9c-4b58-bcd6-470a22da279c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:45.803071 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c7b24-ee9c-4b58-bcd6-470a22da279c admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:45.803839 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c7b24-ee9c-4b58-bcd6-470a22da279c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:15:45.804151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c7b24-ee9c-4b58-bcd6-470a22da279c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:45.805821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c7b24-ee9c-4b58-bcd6-470a22da279c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:45.817779 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1321/2652] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:15:45.822198 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5613e-8084-4897-95dd-80b8c1715475 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:45.831634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5613e-8084-4897-95dd-80b8c1715475 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:45.836475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556580f9-d229-488e-888b-3d6aeb2bd3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:45.837134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556580f9-d229-488e-888b-3d6aeb2bd3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:45.837469 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556580f9-d229-488e-888b-3d6aeb2bd3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:45.837756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556580f9-d229-488e-888b-3d6aeb2bd3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:45.838451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556580f9-d229-488e-888b-3d6aeb2bd3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:45.840369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556580f9-d229-488e-888b-3d6aeb2bd3b0 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:45.932862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1332/2653] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:45 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:45.936975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c7b24-ee9c-4b58-bcd6-470a22da279c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:45.947545 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c7b24-ee9c-4b58-bcd6-470a22da279c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:46.005470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31498770-1513-4d22-820d-0675e912eec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:46.006152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31498770-1513-4d22-820d-0675e912eec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.006434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31498770-1513-4d22-820d-0675e912eec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.006712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31498770-1513-4d22-820d-0675e912eec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.007416 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31498770-1513-4d22-820d-0675e912eec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:46.009323 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31498770-1513-4d22-820d-0675e912eec1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:46.107381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1322/2654] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:45 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:46.111512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556580f9-d229-488e-888b-3d6aeb2bd3b0 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:46.122196 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556580f9-d229-488e-888b-3d6aeb2bd3b0 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:46.130953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482c5d9-2b5d-4035-992e-b26344605787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:46.130953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482c5d9-2b5d-4035-992e-b26344605787 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.130953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482c5d9-2b5d-4035-992e-b26344605787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.130953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482c5d9-2b5d-4035-992e-b26344605787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.131443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482c5d9-2b5d-4035-992e-b26344605787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:46.131443 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482c5d9-2b5d-4035-992e-b26344605787 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:46.141755 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1333/2655] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:46.146204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31498770-1513-4d22-820d-0675e912eec1 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:46.156287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31498770-1513-4d22-820d-0675e912eec1 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:46.161747 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e651a-aa8c-42bf-b17f-7d07557ff701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:46.162402 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e651a-aa8c-42bf-b17f-7d07557ff701 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.162689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e651a-aa8c-42bf-b17f-7d07557ff701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.162962 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e651a-aa8c-42bf-b17f-7d07557ff701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.163682 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e651a-aa8c-42bf-b17f-7d07557ff701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:46.165248 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e651a-aa8c-42bf-b17f-7d07557ff701 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:46.175044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1323/2656] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:46.179442 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482c5d9-2b5d-4035-992e-b26344605787 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:46.189455 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482c5d9-2b5d-4035-992e-b26344605787 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:46.194239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522dee-7d6f-4536-9a3f-dd150b28d2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:46.195118 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522dee-7d6f-4536-9a3f-dd150b28d2eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.195412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522dee-7d6f-4536-9a3f-dd150b28d2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.195702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92522dee-7d6f-4536-9a3f-dd150b28d2eb admin admin] PATH_INFO: `/v3/projects/ed8d47fdd0894d5f8c69cb862359635f/users/816329d23412499f9001028e11ff33b1/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.210928 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92522dee-7d6f-4536-9a3f-dd150b28d2eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8d47fdd0894d5f8c69cb862359635f, user_id=816329d23412499f9001028e11ff33b1, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:46.213648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92522dee-7d6f-4536-9a3f-dd150b28d2eb admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:46.291756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1334/2657] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:46 2022] PUT /identity/v3/projects/ed8d47fdd0894d5f8c69cb862359635f/users/816329d23412499f9001028e11ff33b1/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:46.302265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e175-d70e-435c-a6e2-7bdf2bcab4c9 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.302625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e175-d70e-435c-a6e2-7bdf2bcab4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.305104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e175-d70e-435c-a6e2-7bdf2bcab4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.329557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-b2b3e175-d70e-435c-a6e2-7bdf2bcab4c9 None None] MFA Rules not processed for user `816329d23412499f9001028e11ff33b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:46.330762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-b2b3e175-d70e-435c-a6e2-7bdf2bcab4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:46.396518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1324/2658] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:15:46.401084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522dee-7d6f-4536-9a3f-dd150b28d2eb admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:46.463361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92522dee-7d6f-4536-9a3f-dd150b28d2eb admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:46.468132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d6367-c97d-4dcf-ae8d-d33a34e5b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:46.468793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6367-c97d-4dcf-ae8d-d33a34e5b42a admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.469082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6367-c97d-4dcf-ae8d-d33a34e5b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.469398 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6367-c97d-4dcf-ae8d-d33a34e5b42a admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.470091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d6367-c97d-4dcf-ae8d-d33a34e5b42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:46.472319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d6367-c97d-4dcf-ae8d-d33a34e5b42a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:46.577712 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1335/2659] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:46 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:46.582405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3e175-d70e-435c-a6e2-7bdf2bcab4c9 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:46.593161 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3e175-d70e-435c-a6e2-7bdf2bcab4c9 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:46.649457 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80928f76-95bd-42f8-b45a-e09b57723113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:46.650033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80928f76-95bd-42f8-b45a-e09b57723113 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.650324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80928f76-95bd-42f8-b45a-e09b57723113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.650604 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80928f76-95bd-42f8-b45a-e09b57723113 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.651301 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80928f76-95bd-42f8-b45a-e09b57723113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:46.653196 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80928f76-95bd-42f8-b45a-e09b57723113 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:46.701737 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1325/2660] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:46 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:46.705692 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d6367-c97d-4dcf-ae8d-d33a34e5b42a admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:46.716909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d6367-c97d-4dcf-ae8d-d33a34e5b42a admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:46.721605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8740e-931b-447f-92d8-6d9cffbacf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:46.723236 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8740e-931b-447f-92d8-6d9cffbacf00 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.723529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8740e-931b-447f-92d8-6d9cffbacf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.723809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8740e-931b-447f-92d8-6d9cffbacf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.724528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8740e-931b-447f-92d8-6d9cffbacf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:46.726151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8740e-931b-447f-92d8-6d9cffbacf00 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:46.736561 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1336/2661] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:46.740793 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80928f76-95bd-42f8-b45a-e09b57723113 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:46.750572 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80928f76-95bd-42f8-b45a-e09b57723113 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:46.755113 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e837323-4765-4804-9c62-b10f7c95b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:46.755985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e837323-4765-4804-9c62-b10f7c95b032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.756269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e837323-4765-4804-9c62-b10f7c95b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.756544 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e837323-4765-4804-9c62-b10f7c95b032 admin admin] PATH_INFO: `/v3/projects/172700d4da91434ab403b772ea969f36/users/7c7a6320bd5b47698a559c07990b3782/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.772245 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e837323-4765-4804-9c62-b10f7c95b032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172700d4da91434ab403b772ea969f36, user_id=7c7a6320bd5b47698a559c07990b3782, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:46.774954 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e837323-4765-4804-9c62-b10f7c95b032 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:46.844656 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1326/2662] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:46 2022] PUT /identity/v3/projects/172700d4da91434ab403b772ea969f36/users/7c7a6320bd5b47698a559c07990b3782/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:46.849423 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8740e-931b-447f-92d8-6d9cffbacf00 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:46.859174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8740e-931b-447f-92d8-6d9cffbacf00 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:46.914416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797afc88-b948-474c-8f8e-a677e03c0216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:46.914990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797afc88-b948-474c-8f8e-a677e03c0216 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.915272 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797afc88-b948-474c-8f8e-a677e03c0216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.915544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797afc88-b948-474c-8f8e-a677e03c0216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.916254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797afc88-b948-474c-8f8e-a677e03c0216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:46.917867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797afc88-b948-474c-8f8e-a677e03c0216 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:46.928227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1337/2663] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:46.932317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e837323-4765-4804-9c62-b10f7c95b032 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:46.942466 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e837323-4765-4804-9c62-b10f7c95b032 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:46.947127 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3243d-3478-4d8a-82ab-35ff698ef883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:46.948017 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3243d-3478-4d8a-82ab-35ff698ef883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:46.948303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3243d-3478-4d8a-82ab-35ff698ef883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:46.948581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3243d-3478-4d8a-82ab-35ff698ef883 admin admin] PATH_INFO: `/v3/projects/172700d4da91434ab403b772ea969f36/users/7c7a6320bd5b47698a559c07990b3782/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:46.950575 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3243d-3478-4d8a-82ab-35ff698ef883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172700d4da91434ab403b772ea969f36, user_id=7c7a6320bd5b47698a559c07990b3782, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:46.953189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3243d-3478-4d8a-82ab-35ff698ef883 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:46.964644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1327/2664] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:46 2022] PUT /identity/v3/projects/172700d4da91434ab403b772ea969f36/users/7c7a6320bd5b47698a559c07990b3782/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:47.025881 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5c73c-90c0-4400-be00-7064a7804454 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:47.026174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5c73c-90c0-4400-be00-7064a7804454 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:47.026461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5c73c-90c0-4400-be00-7064a7804454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:47.052966 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d7b5c73c-90c0-4400-be00-7064a7804454 None None] MFA Rules not processed for user `7c7a6320bd5b47698a559c07990b3782`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:47.054215 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d7b5c73c-90c0-4400-be00-7064a7804454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:47.128368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1338/2665] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:47.139638 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3243d-3478-4d8a-82ab-35ff698ef883 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:47.141388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4cf3243d-3478-4d8a-82ab-35ff698ef883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:47.199277 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3243d-3478-4d8a-82ab-35ff698ef883 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:47.203018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2225c-2c82-4a93-80d2-ea6c163c1328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:47.203700 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2225c-2c82-4a93-80d2-ea6c163c1328 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:47.203988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2225c-2c82-4a93-80d2-ea6c163c1328 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:47.204287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2225c-2c82-4a93-80d2-ea6c163c1328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:47.213651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2225c-2c82-4a93-80d2-ea6c163c1328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:47.215096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2225c-2c82-4a93-80d2-ea6c163c1328 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:47.227912 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1328/2666] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:47.358050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5c73c-90c0-4400-be00-7064a7804454 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:47.359589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d7b5c73c-90c0-4400-be00-7064a7804454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:47.372756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5c73c-90c0-4400-be00-7064a7804454 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:47.376365 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8c82d-cc0b-48fb-89b2-5a09190de9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:47.377010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c82d-cc0b-48fb-89b2-5a09190de9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:47.377315 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c82d-cc0b-48fb-89b2-5a09190de9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:47.377600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c82d-cc0b-48fb-89b2-5a09190de9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:47.435724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8c82d-cc0b-48fb-89b2-5a09190de9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:47.437183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8c82d-cc0b-48fb-89b2-5a09190de9a3 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:47.446580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1339/2667] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:52.100426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2225c-2c82-4a93-80d2-ea6c163c1328 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:52.164304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2225c-2c82-4a93-80d2-ea6c163c1328 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:52.168759 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:52.169655 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:52.169963 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:52.170242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] PATH_INFO: `/v3/users/816329d23412499f9001028e11ff33b1` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:52.171414 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816329d23412499f9001028e11ff33b1)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:52.173318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:52.378935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816329d23412499f9001028e11ff33b1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:52.391107 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816329d23412499f9001028e11ff33b1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:52.391834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816329d23412499f9001028e11ff33b1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:52.479822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816329d23412499f9001028e11ff33b1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:52.487504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816329d23412499f9001028e11ff33b1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:52.494170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1329/2668] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:52 2022] DELETE /identity/v3/users/816329d23412499f9001028e11ff33b1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:52.500092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beee10-8d2f-44f1-9b56-34c143ba7805 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:52.500637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beee10-8d2f-44f1-9b56-34c143ba7805 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:52.501332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beee10-8d2f-44f1-9b56-34c143ba7805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:52.523062 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d5beee10-8d2f-44f1-9b56-34c143ba7805 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:52.524300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d5beee10-8d2f-44f1-9b56-34c143ba7805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:52.589717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1340/2669] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:52.599500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:52.601068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:52.660162 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa49da1-4cbf-44fd-8aba-717ecb126677 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:52.664046 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1e53-aafc-4b8c-b7ff-03814be5319e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:52.664702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1e53-aafc-4b8c-b7ff-03814be5319e service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:52.664988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1e53-aafc-4b8c-b7ff-03814be5319e service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:52.665268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1e53-aafc-4b8c-b7ff-03814be5319e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:52.674863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd1e53-aafc-4b8c-b7ff-03814be5319e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:52.676299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd1e53-aafc-4b8c-b7ff-03814be5319e service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:52.686726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1330/2670] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:53.113137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beee10-8d2f-44f1-9b56-34c143ba7805 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:53.114830 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d5beee10-8d2f-44f1-9b56-34c143ba7805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:53.127537 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beee10-8d2f-44f1-9b56-34c143ba7805 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:53.132700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:53.133605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:53.133885 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:53.134158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] PATH_INFO: `/v3/projects/ed8d47fdd0894d5f8c69cb862359635f` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:53.135401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8d47fdd0894d5f8c69cb862359635f)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:53.137293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:53.239427 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8d47fdd0894d5f8c69cb862359635f', 'request_id': 'req-720275d9-58d1-45e8-adf3-5785cfa2d741'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:53.245576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8d47fdd0894d5f8c69cb862359635f', 'request_id': 'req-720275d9-58d1-45e8-adf3-5785cfa2d741'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:53.307211 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8d47fdd0894d5f8c69cb862359635f', 'request_id': 'req-720275d9-58d1-45e8-adf3-5785cfa2d741'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:53.319114 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] The token cache is being invalidate because project ed8d47fdd0894d5f8c69cb862359635f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:53.319406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:53.320117 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:53.322044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1341/2671] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:53 2022] DELETE /identity/v3/projects/ed8d47fdd0894d5f8c69cb862359635f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:53.326278 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1e53-aafc-4b8c-b7ff-03814be5319e service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:53.336461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1e53-aafc-4b8c-b7ff-03814be5319e service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:53.392567 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:53.393484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:53.393774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:53.394055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] PATH_INFO: `/v3/users/7c7a6320bd5b47698a559c07990b3782` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:53.395856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7a6320bd5b47698a559c07990b3782)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:53.398312 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:53.566425 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7a6320bd5b47698a559c07990b3782'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:53.578355 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7a6320bd5b47698a559c07990b3782'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:53.579036 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7a6320bd5b47698a559c07990b3782'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:53.644714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7a6320bd5b47698a559c07990b3782'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:53.652563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e24dcefc-4ffd-40ed-b68d-b1e17387b8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7a6320bd5b47698a559c07990b3782'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:53.659092 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1331/2672] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:53 2022] DELETE /identity/v3/users/7c7a6320bd5b47698a559c07990b3782 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:54.059816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:54.059816 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:54.075108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720275d9-58d1-45e8-adf3-5785cfa2d741 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:54.151518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:54.152676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:54.153818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:54.153952 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] PATH_INFO: `/v3/projects/172700d4da91434ab403b772ea969f36` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:54.155325 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=172700d4da91434ab403b772ea969f36)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:54.157416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:54.319795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172700d4da91434ab403b772ea969f36', 'request_id': 'req-f881e769-c892-4c80-a0bf-2b5397781178'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:54.325070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172700d4da91434ab403b772ea969f36', 'request_id': 'req-f881e769-c892-4c80-a0bf-2b5397781178'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:54.416780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172700d4da91434ab403b772ea969f36', 'request_id': 'req-f881e769-c892-4c80-a0bf-2b5397781178'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:54.428891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] The token cache is being invalidate because project 172700d4da91434ab403b772ea969f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:54.429186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:54.429887 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f881e769-c892-4c80-a0bf-2b5397781178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:54.431461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1342/2673] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:54 2022] DELETE /identity/v3/projects/172700d4da91434ab403b772ea969f36 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:54.437396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba38b9-83a4-4379-9a81-c330ab2f3eff None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:54.437860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba38b9-83a4-4379-9a81-c330ab2f3eff None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:54.438191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba38b9-83a4-4379-9a81-c330ab2f3eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:54.464974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-c1ba38b9-83a4-4379-9a81-c330ab2f3eff None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:54.466258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c1ba38b9-83a4-4379-9a81-c330ab2f3eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:54.536971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1332/2674] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:54.545762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bcaf5-c964-4e92-9a00-e21773a96f29 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:54.546056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bcaf5-c964-4e92-9a00-e21773a96f29 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:54.546346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bcaf5-c964-4e92-9a00-e21773a96f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:54.565411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-4d2bcaf5-c964-4e92-9a00-e21773a96f29 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:54.566637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-4d2bcaf5-c964-4e92-9a00-e21773a96f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:54.575757 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1343/2675] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:54.580318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba38b9-83a4-4379-9a81-c330ab2f3eff None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:54.591723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba38b9-83a4-4379-9a81-c330ab2f3eff None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:54.596397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c363b2-b555-453d-b1b6-c4bf0172c946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:54.609066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c363b2-b555-453d-b1b6-c4bf0172c946 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:54.609066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c363b2-b555-453d-b1b6-c4bf0172c946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:54.609066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c363b2-b555-453d-b1b6-c4bf0172c946 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:54.609066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c363b2-b555-453d-b1b6-c4bf0172c946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:15:54.609066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c363b2-b555-453d-b1b6-c4bf0172c946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:54.609066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c363b2-b555-453d-b1b6-c4bf0172c946 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:54.613488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1333/2676] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:15:54.618124 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bcaf5-c964-4e92-9a00-e21773a96f29 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:54.627984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bcaf5-c964-4e92-9a00-e21773a96f29 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:54.633181 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58883f4-6fc5-4070-8388-d2b074e05807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:54.633880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58883f4-6fc5-4070-8388-d2b074e05807 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:54.634165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58883f4-6fc5-4070-8388-d2b074e05807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:54.634467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58883f4-6fc5-4070-8388-d2b074e05807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:54.635157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58883f4-6fc5-4070-8388-d2b074e05807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:54.637094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58883f4-6fc5-4070-8388-d2b074e05807 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:54.737531 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1344/2677] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:54 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:54.741935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c363b2-b555-453d-b1b6-c4bf0172c946 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:54.752033 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c363b2-b555-453d-b1b6-c4bf0172c946 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:54.814642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb59427-e730-4c9c-91c8-53964749aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:54.815337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb59427-e730-4c9c-91c8-53964749aae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:54.815618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb59427-e730-4c9c-91c8-53964749aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:54.815891 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb59427-e730-4c9c-91c8-53964749aae4 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:54.816618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb59427-e730-4c9c-91c8-53964749aae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:54.818637 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb59427-e730-4c9c-91c8-53964749aae4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:54.908008 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1334/2678] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:54 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:15:54.912177 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58883f4-6fc5-4070-8388-d2b074e05807 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:54.923069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58883f4-6fc5-4070-8388-d2b074e05807 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:54.928766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d582d8-52d4-40c0-909a-87524b7b7a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:54.929523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d582d8-52d4-40c0-909a-87524b7b7a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:54.929803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d582d8-52d4-40c0-909a-87524b7b7a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:54.930064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d582d8-52d4-40c0-909a-87524b7b7a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:54.930790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d582d8-52d4-40c0-909a-87524b7b7a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:54.932398 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d582d8-52d4-40c0-909a-87524b7b7a98 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:54.945334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1345/2679] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:54.949534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb59427-e730-4c9c-91c8-53964749aae4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:54.962171 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb59427-e730-4c9c-91c8-53964749aae4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:54.968636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993706da-d567-41a2-a86e-73c5f26cd1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:54.969338 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993706da-d567-41a2-a86e-73c5f26cd1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:54.969633 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993706da-d567-41a2-a86e-73c5f26cd1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:54.969910 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993706da-d567-41a2-a86e-73c5f26cd1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:54.970639 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993706da-d567-41a2-a86e-73c5f26cd1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:54.972231 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993706da-d567-41a2-a86e-73c5f26cd1f0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:54.983076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1335/2680] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:54.987244 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d582d8-52d4-40c0-909a-87524b7b7a98 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:54.997823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d582d8-52d4-40c0-909a-87524b7b7a98 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:55.002731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700436d-a25b-41ea-9513-b6995f2b7be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:55.003650 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700436d-a25b-41ea-9513-b6995f2b7be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:55.003937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700436d-a25b-41ea-9513-b6995f2b7be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:55.004218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700436d-a25b-41ea-9513-b6995f2b7be6 admin admin] PATH_INFO: `/v3/projects/6ccd8acc5b844615a8fcb869636e5bfa/users/28ec7c65061e4d79b1a8bf1aeb706cb2/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:55.019889 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700436d-a25b-41ea-9513-b6995f2b7be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccd8acc5b844615a8fcb869636e5bfa, user_id=28ec7c65061e4d79b1a8bf1aeb706cb2, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:55.023537 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700436d-a25b-41ea-9513-b6995f2b7be6 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:55.100039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1346/2681] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:54 2022] PUT /identity/v3/projects/6ccd8acc5b844615a8fcb869636e5bfa/users/28ec7c65061e4d79b1a8bf1aeb706cb2/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:55.110782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d729ed6-50eb-4fda-a48c-bc33d0228563 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:55.111082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d729ed6-50eb-4fda-a48c-bc33d0228563 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:55.111540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d729ed6-50eb-4fda-a48c-bc33d0228563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:55.142897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-4d729ed6-50eb-4fda-a48c-bc33d0228563 None None] MFA Rules not processed for user `28ec7c65061e4d79b1a8bf1aeb706cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:55.144109 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4d729ed6-50eb-4fda-a48c-bc33d0228563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:55.210102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1336/2682] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:55.216007 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700436d-a25b-41ea-9513-b6995f2b7be6 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:55.283213 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700436d-a25b-41ea-9513-b6995f2b7be6 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:55.287867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6a7f-0e18-44df-b998-7907777ed912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:55.288981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6a7f-0e18-44df-b998-7907777ed912 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:55.289256 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6a7f-0e18-44df-b998-7907777ed912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:55.289566 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6a7f-0e18-44df-b998-7907777ed912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:55.290271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c6a7f-0e18-44df-b998-7907777ed912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:55.292161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c6a7f-0e18-44df-b998-7907777ed912 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:55.386088 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1347/2683] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:55 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:15:55.392874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d729ed6-50eb-4fda-a48c-bc33d0228563 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:55.404336 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d729ed6-50eb-4fda-a48c-bc33d0228563 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:55.469915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ab8fc-5d62-4b26-bfa9-1667576f2246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:55.470754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab8fc-5d62-4b26-bfa9-1667576f2246 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:55.471043 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab8fc-5d62-4b26-bfa9-1667576f2246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:55.471316 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab8fc-5d62-4b26-bfa9-1667576f2246 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:55.472020 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ab8fc-5d62-4b26-bfa9-1667576f2246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:55.474006 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ab8fc-5d62-4b26-bfa9-1667576f2246 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:55.571212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1337/2684] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:55 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:55.573150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6a7f-0e18-44df-b998-7907777ed912 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:55.584556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6a7f-0e18-44df-b998-7907777ed912 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:55.589596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869492-669b-4177-aac4-be5b35f9527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:55.590284 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869492-669b-4177-aac4-be5b35f9527f admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:55.590588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869492-669b-4177-aac4-be5b35f9527f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:55.590862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869492-669b-4177-aac4-be5b35f9527f admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:55.591592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0869492-669b-4177-aac4-be5b35f9527f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:55.593186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0869492-669b-4177-aac4-be5b35f9527f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:55.605680 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1348/2685] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:55.609937 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ab8fc-5d62-4b26-bfa9-1667576f2246 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:55.620932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ab8fc-5d62-4b26-bfa9-1667576f2246 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:55.625818 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b0b55-0cb8-4ec6-8620-f375fc037ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:55.628317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0b55-0cb8-4ec6-8620-f375fc037ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:55.628317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0b55-0cb8-4ec6-8620-f375fc037ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:55.628317 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b0b55-0cb8-4ec6-8620-f375fc037ba3 admin admin] PATH_INFO: `/v3/projects/56d89c980c394c19aa7553a7c830908e/users/8fe917addf694dd48160747483a44dc2/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:55.642689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b0b55-0cb8-4ec6-8620-f375fc037ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d89c980c394c19aa7553a7c830908e, user_id=8fe917addf694dd48160747483a44dc2, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:55.645395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b0b55-0cb8-4ec6-8620-f375fc037ba3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:55.719128 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1338/2686] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:55 2022] PUT /identity/v3/projects/56d89c980c394c19aa7553a7c830908e/users/8fe917addf694dd48160747483a44dc2/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:15:55.722970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869492-669b-4177-aac4-be5b35f9527f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:55.738258 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869492-669b-4177-aac4-be5b35f9527f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:55.808270 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3a7bf-e699-4097-9035-9d7264daa0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:55.809485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3a7bf-e699-4097-9035-9d7264daa0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:55.809485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3a7bf-e699-4097-9035-9d7264daa0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:55.810829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3a7bf-e699-4097-9035-9d7264daa0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:55.810829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3a7bf-e699-4097-9035-9d7264daa0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:55.812003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3a7bf-e699-4097-9035-9d7264daa0bb admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:55.823093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1349/2687] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:15:55.828870 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b0b55-0cb8-4ec6-8620-f375fc037ba3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:55.843326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b0b55-0cb8-4ec6-8620-f375fc037ba3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:55.850347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a10c3d-a18a-48b5-a24f-488eb90eea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:55.851917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10c3d-a18a-48b5-a24f-488eb90eea48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:55.852201 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10c3d-a18a-48b5-a24f-488eb90eea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:55.852484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10c3d-a18a-48b5-a24f-488eb90eea48 admin admin] PATH_INFO: `/v3/projects/56d89c980c394c19aa7553a7c830908e/users/8fe917addf694dd48160747483a44dc2/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:55.855262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a10c3d-a18a-48b5-a24f-488eb90eea48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d89c980c394c19aa7553a7c830908e, user_id=8fe917addf694dd48160747483a44dc2, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:55.857957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a10c3d-a18a-48b5-a24f-488eb90eea48 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:55.870733 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1339/2688] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:55 2022] PUT /identity/v3/projects/56d89c980c394c19aa7553a7c830908e/users/8fe917addf694dd48160747483a44dc2/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:55.882510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73e546-8514-428b-a85d-8fcd2ea4540d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:55.882802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73e546-8514-428b-a85d-8fcd2ea4540d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:55.886311 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73e546-8514-428b-a85d-8fcd2ea4540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:55.914286 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-6c73e546-8514-428b-a85d-8fcd2ea4540d None None] MFA Rules not processed for user `8fe917addf694dd48160747483a44dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:55.915918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6c73e546-8514-428b-a85d-8fcd2ea4540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:56.000116 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1350/2689] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:56.011727 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a10c3d-a18a-48b5-a24f-488eb90eea48 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:56.013456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e9a10c3d-a18a-48b5-a24f-488eb90eea48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:56.072405 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a10c3d-a18a-48b5-a24f-488eb90eea48 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:56.076199 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07052ab-4dc4-4e39-9cf6-5e20429d9b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:56.076868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07052ab-4dc4-4e39-9cf6-5e20429d9b36 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:56.077131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07052ab-4dc4-4e39-9cf6-5e20429d9b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:56.077448 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07052ab-4dc4-4e39-9cf6-5e20429d9b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:56.087425 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07052ab-4dc4-4e39-9cf6-5e20429d9b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:56.088859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07052ab-4dc4-4e39-9cf6-5e20429d9b36 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:56.098200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1340/2690] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:15:57.049573 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73e546-8514-428b-a85d-8fcd2ea4540d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:57.111651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73e546-8514-428b-a85d-8fcd2ea4540d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:57.116146 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:57.117428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:57.117715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:57.117991 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] PATH_INFO: `/v3/users/28ec7c65061e4d79b1a8bf1aeb706cb2` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:57.119211 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ec7c65061e4d79b1a8bf1aeb706cb2)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:57.121165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:57.320938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ec7c65061e4d79b1a8bf1aeb706cb2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:57.321589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ec7c65061e4d79b1a8bf1aeb706cb2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:57.322190 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ec7c65061e4d79b1a8bf1aeb706cb2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:57.333518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ec7c65061e4d79b1a8bf1aeb706cb2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:57.341098 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ec7c65061e4d79b1a8bf1aeb706cb2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:57.427408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1351/2691] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:57 2022] DELETE /identity/v3/users/28ec7c65061e4d79b1a8bf1aeb706cb2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:57.433887 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5115cf-b550-4bb1-879a-0272105812cc None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:57.434388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5115cf-b550-4bb1-879a-0272105812cc None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:57.434515 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5115cf-b550-4bb1-879a-0272105812cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:57.452299 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-dd5115cf-b550-4bb1-879a-0272105812cc None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:57.453528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-dd5115cf-b550-4bb1-879a-0272105812cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:57.512848 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1341/2692] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:57.522912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:57.524596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:57.582701 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211878f-4c87-43ae-aa58-2a3a466c6d33 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:57.587072 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963c031-0d10-4737-9d12-99d002a25520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:57.587724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963c031-0d10-4737-9d12-99d002a25520 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:57.588011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963c031-0d10-4737-9d12-99d002a25520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:57.588293 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963c031-0d10-4737-9d12-99d002a25520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:57.602606 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963c031-0d10-4737-9d12-99d002a25520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:57.604060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963c031-0d10-4737-9d12-99d002a25520 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:57.614176 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1352/2693] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:15:57.989710 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5115cf-b550-4bb1-879a-0272105812cc None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:57.991182 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-dd5115cf-b550-4bb1-879a-0272105812cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:58.003946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5115cf-b550-4bb1-879a-0272105812cc None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:58.009132 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:58.009906 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:58.010194 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:58.010474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] PATH_INFO: `/v3/projects/6ccd8acc5b844615a8fcb869636e5bfa` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:58.011705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ccd8acc5b844615a8fcb869636e5bfa)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:58.013661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:58.121357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ccd8acc5b844615a8fcb869636e5bfa', 'request_id': 'req-461e7f41-d6e6-42aa-a51c-28f5904c01b8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:58.127151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ccd8acc5b844615a8fcb869636e5bfa', 'request_id': 'req-461e7f41-d6e6-42aa-a51c-28f5904c01b8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:58.181562 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ccd8acc5b844615a8fcb869636e5bfa', 'request_id': 'req-461e7f41-d6e6-42aa-a51c-28f5904c01b8'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:58.192895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] The token cache is being invalidate because project 6ccd8acc5b844615a8fcb869636e5bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:58.193184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:58.193836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:58.195525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1342/2694] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:57 2022] DELETE /identity/v3/projects/6ccd8acc5b844615a8fcb869636e5bfa => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:58.200040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963c031-0d10-4737-9d12-99d002a25520 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:58.209848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963c031-0d10-4737-9d12-99d002a25520 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:58.272040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:58.273465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:58.273751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:58.274033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] PATH_INFO: `/v3/users/8fe917addf694dd48160747483a44dc2` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:58.275253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe917addf694dd48160747483a44dc2)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:58.277168 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:58.498035 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe917addf694dd48160747483a44dc2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:58.498702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe917addf694dd48160747483a44dc2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:58.499334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe917addf694dd48160747483a44dc2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:58.511056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe917addf694dd48160747483a44dc2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:58.517702 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-627dfd1a-6857-4e1a-8ccf-314793ac0e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe917addf694dd48160747483a44dc2'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:58.598941 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1353/2695] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:15:58 2022] DELETE /identity/v3/users/8fe917addf694dd48160747483a44dc2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:59.001067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:59.002531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:59.016528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e7f41-d6e6-42aa-a51c-28f5904c01b8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:59.074931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:59.075795 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:59.076078 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:59.076407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] PATH_INFO: `/v3/projects/56d89c980c394c19aa7553a7c830908e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:59.077721 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d89c980c394c19aa7553a7c830908e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:59.079588 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:59.211803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d89c980c394c19aa7553a7c830908e', 'request_id': 'req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:59.217329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d89c980c394c19aa7553a7c830908e', 'request_id': 'req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:59.278787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d89c980c394c19aa7553a7c830908e', 'request_id': 'req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:59.290702 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] The token cache is being invalidate because project 56d89c980c394c19aa7553a7c830908e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:15:59.290987 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:59.291624 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9d51ee24-2e0a-4cb1-99aa-d14a0b362cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:15:59.293166 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1343/2696] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:15:58 2022] DELETE /identity/v3/projects/56d89c980c394c19aa7553a7c830908e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:59.298076 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7225a-085c-4bc3-973d-921c32b5c081 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:59.298563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7225a-085c-4bc3-973d-921c32b5c081 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:59.298670 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7225a-085c-4bc3-973d-921c32b5c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:59.324349 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-5fe7225a-085c-4bc3-973d-921c32b5c081 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:59.325638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-5fe7225a-085c-4bc3-973d-921c32b5c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:59.383750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1354/2697] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:59.391565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bb0ea-245c-4ac9-b844-f5186fc44d2d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:59.391853 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bb0ea-245c-4ac9-b844-f5186fc44d2d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:59.392158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bb0ea-245c-4ac9-b844-f5186fc44d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:59.413104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-001bb0ea-245c-4ac9-b844-f5186fc44d2d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:59.414994 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-001bb0ea-245c-4ac9-b844-f5186fc44d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:15:59.422991 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1344/2698] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:15:59.427152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7225a-085c-4bc3-973d-921c32b5c081 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:59.437752 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7225a-085c-4bc3-973d-921c32b5c081 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:59.442467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17eda8-d335-48ab-bd37-6347f58be7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:59.443137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17eda8-d335-48ab-bd37-6347f58be7ab admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:59.443423 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17eda8-d335-48ab-bd37-6347f58be7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:59.443705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17eda8-d335-48ab-bd37-6347f58be7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:59.445172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17eda8-d335-48ab-bd37-6347f58be7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:15:59.445518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17eda8-d335-48ab-bd37-6347f58be7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:59.447137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17eda8-d335-48ab-bd37-6347f58be7ab admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:59.458992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1355/2699] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:15:59.463846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bb0ea-245c-4ac9-b844-f5186fc44d2d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:59.472909 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bb0ea-245c-4ac9-b844-f5186fc44d2d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:59.477744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef81c-92b4-4b68-83ee-a3727503dbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:59.478400 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef81c-92b4-4b68-83ee-a3727503dbad admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:59.478688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef81c-92b4-4b68-83ee-a3727503dbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:59.478968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef81c-92b4-4b68-83ee-a3727503dbad admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:59.479662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edef81c-92b4-4b68-83ee-a3727503dbad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:59.481580 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edef81c-92b4-4b68-83ee-a3727503dbad admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:59.592754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1345/2700] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:15:59 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:59.594142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17eda8-d335-48ab-bd37-6347f58be7ab admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:59.604750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17eda8-d335-48ab-bd37-6347f58be7ab admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:59.661143 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de389-d51c-43fe-bb70-4678518c3dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:59.662172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de389-d51c-43fe-bb70-4678518c3dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:59.662465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de389-d51c-43fe-bb70-4678518c3dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:59.662750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de389-d51c-43fe-bb70-4678518c3dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:59.664214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4de389-d51c-43fe-bb70-4678518c3dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:59.666160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4de389-d51c-43fe-bb70-4678518c3dc8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:59.736186 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1356/2701] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:15:59 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:15:59.740145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef81c-92b4-4b68-83ee-a3727503dbad admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:59.751454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef81c-92b4-4b68-83ee-a3727503dbad admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:59.756190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43817a94-be19-483d-b742-f0844f85b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:59.756847 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817a94-be19-483d-b742-f0844f85b52a admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:59.757540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817a94-be19-483d-b742-f0844f85b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:59.757757 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817a94-be19-483d-b742-f0844f85b52a admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:59.758483 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43817a94-be19-483d-b742-f0844f85b52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:59.760055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43817a94-be19-483d-b742-f0844f85b52a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:59.770512 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1346/2702] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:59.775520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de389-d51c-43fe-bb70-4678518c3dc8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:59.785472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de389-d51c-43fe-bb70-4678518c3dc8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:59.790953 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d40a3-3a40-49a0-8823-a2586fc7f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:59.791620 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d40a3-3a40-49a0-8823-a2586fc7f411 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:59.791907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d40a3-3a40-49a0-8823-a2586fc7f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:59.792193 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d40a3-3a40-49a0-8823-a2586fc7f411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:59.792915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d40a3-3a40-49a0-8823-a2586fc7f411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:59.794549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d40a3-3a40-49a0-8823-a2586fc7f411 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:59.805188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1357/2703] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:15:59.809459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43817a94-be19-483d-b742-f0844f85b52a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:15:59.819172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43817a94-be19-483d-b742-f0844f85b52a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:15:59.824886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551bf30-4b6a-4899-bf3d-70915f6ec75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:15:59.825778 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551bf30-4b6a-4899-bf3d-70915f6ec75f admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:59.826072 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551bf30-4b6a-4899-bf3d-70915f6ec75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:59.826346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551bf30-4b6a-4899-bf3d-70915f6ec75f admin admin] PATH_INFO: `/v3/projects/f56f742dee94447581556206925f0943/users/f2246582720a4c4eb61b4a7e8eb79bc3/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:59.840971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551bf30-4b6a-4899-bf3d-70915f6ec75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56f742dee94447581556206925f0943, user_id=f2246582720a4c4eb61b4a7e8eb79bc3, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:15:59.849960 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551bf30-4b6a-4899-bf3d-70915f6ec75f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:15:59.908026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1347/2704] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:15:59 2022] PUT /identity/v3/projects/f56f742dee94447581556206925f0943/users/f2246582720a4c4eb61b4a7e8eb79bc3/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:15:59.919896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a00fa7-6fc9-4a6b-a39b-df427f0166c7 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:15:59.920238 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a00fa7-6fc9-4a6b-a39b-df427f0166c7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:15:59.920480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a00fa7-6fc9-4a6b-a39b-df427f0166c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:15:59.948795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-95a00fa7-6fc9-4a6b-a39b-df427f0166c7 None None] MFA Rules not processed for user `f2246582720a4c4eb61b4a7e8eb79bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:15:59.950038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-95a00fa7-6fc9-4a6b-a39b-df427f0166c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:00.015025 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1358/2705] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:00.026359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551bf30-4b6a-4899-bf3d-70915f6ec75f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:00.028803 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7551bf30-4b6a-4899-bf3d-70915f6ec75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:00.088689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551bf30-4b6a-4899-bf3d-70915f6ec75f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:00.092385 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7b9ec-1643-4fdf-9396-3cdec68453aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f8ec4765e05461a98b3c9eb1d3ced5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:00.098741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b9ec-1643-4fdf-9396-3cdec68453aa service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:00.098741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b9ec-1643-4fdf-9396-3cdec68453aa service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:00.098741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b9ec-1643-4fdf-9396-3cdec68453aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:00.103265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7b9ec-1643-4fdf-9396-3cdec68453aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:00.104645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7b9ec-1643-4fdf-9396-3cdec68453aa service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:00.113685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1348/2706] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:16:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:16:06.073775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a00fa7-6fc9-4a6b-a39b-df427f0166c7 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:06.075188 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-95a00fa7-6fc9-4a6b-a39b-df427f0166c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:06.151050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a00fa7-6fc9-4a6b-a39b-df427f0166c7 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:06.155801 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:06.156676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:06.156963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:06.157344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] PATH_INFO: `/v3/users/ac4d83e459a841f3ba28dfa6c4378846` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:06.158634 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4d83e459a841f3ba28dfa6c4378846)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:06.160411 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:06.325058 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4d83e459a841f3ba28dfa6c4378846'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:06.325752 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4d83e459a841f3ba28dfa6c4378846'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:06.326494 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4d83e459a841f3ba28dfa6c4378846'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:06.339206 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4d83e459a841f3ba28dfa6c4378846'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:06.345997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4d83e459a841f3ba28dfa6c4378846'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:06.427770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1359/2707] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:16:06 2022] DELETE /identity/v3/users/ac4d83e459a841f3ba28dfa6c4378846 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:16:06.433169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb21be-9897-4821-87e2-e72277b5cf73 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:06.433677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb21be-9897-4821-87e2-e72277b5cf73 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:06.441074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb21be-9897-4821-87e2-e72277b5cf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:06.451849 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-d5cb21be-9897-4821-87e2-e72277b5cf73 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:06.453067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d5cb21be-9897-4821-87e2-e72277b5cf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:06.516437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1349/2708] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:06.527466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:06.528950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:06.584240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7302f6-3789-483e-9ae4-f1424def53b9 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:06.588717 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6676df-8277-4e8f-86c4-859e38d45dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:06.589395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6676df-8277-4e8f-86c4-859e38d45dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:06.589682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6676df-8277-4e8f-86c4-859e38d45dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:06.589961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6676df-8277-4e8f-86c4-859e38d45dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:06.598884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6676df-8277-4e8f-86c4-859e38d45dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:06.600302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6676df-8277-4e8f-86c4-859e38d45dc3 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:06.612493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1360/2709] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:16:07.047951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb21be-9897-4821-87e2-e72277b5cf73 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:07.048782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d5cb21be-9897-4821-87e2-e72277b5cf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:07.065563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb21be-9897-4821-87e2-e72277b5cf73 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:07.072455 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:07.073698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:07.074110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:07.074630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] PATH_INFO: `/v3/projects/8622fd304ec04eefb111dad635939487` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:07.076168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8622fd304ec04eefb111dad635939487)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:07.078814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:07.225626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8622fd304ec04eefb111dad635939487', 'request_id': 'req-047a23d8-a33c-432a-9d40-f959cc40c5f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:07.231591 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8622fd304ec04eefb111dad635939487', 'request_id': 'req-047a23d8-a33c-432a-9d40-f959cc40c5f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:07.301940 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8622fd304ec04eefb111dad635939487', 'request_id': 'req-047a23d8-a33c-432a-9d40-f959cc40c5f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:07.316233 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] The token cache is being invalidate because project 8622fd304ec04eefb111dad635939487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:16:07.316731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:07.317540 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-047a23d8-a33c-432a-9d40-f959cc40c5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:07.320084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1350/2710] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:16:07 2022] DELETE /identity/v3/projects/8622fd304ec04eefb111dad635939487 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:16:07.326019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba21a1-9b2b-488e-b025-e2f6756ebc5f None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:07.326580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba21a1-9b2b-488e-b025-e2f6756ebc5f None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:07.326580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba21a1-9b2b-488e-b025-e2f6756ebc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:07.344662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f2ba21a1-9b2b-488e-b025-e2f6756ebc5f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:07.345958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f2ba21a1-9b2b-488e-b025-e2f6756ebc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:07.411523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1361/2711] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:07.421996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58679-323e-49a1-942d-905702bb85a5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:07.422292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58679-323e-49a1-942d-905702bb85a5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:07.422607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58679-323e-49a1-942d-905702bb85a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:07.443030 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-feb58679-323e-49a1-942d-905702bb85a5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:07.444237 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-feb58679-323e-49a1-942d-905702bb85a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:07.453113 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1351/2712] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:07.457536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba21a1-9b2b-488e-b025-e2f6756ebc5f None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:07.467254 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba21a1-9b2b-488e-b025-e2f6756ebc5f None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:07.473975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134c077-9156-4436-981b-a72d617e55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:07.475149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134c077-9156-4436-981b-a72d617e55fb admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:07.475603 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134c077-9156-4436-981b-a72d617e55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:07.476248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134c077-9156-4436-981b-a72d617e55fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:07.478351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134c077-9156-4436-981b-a72d617e55fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:16:07.478879 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134c077-9156-4436-981b-a72d617e55fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:07.481950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134c077-9156-4436-981b-a72d617e55fb admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:07.496789 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1362/2713] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:16:07.501297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58679-323e-49a1-942d-905702bb85a5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:07.511015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58679-323e-49a1-942d-905702bb85a5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:07.516035 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd9910-7d80-407c-8f63-013dd57f6f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:07.516688 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd9910-7d80-407c-8f63-013dd57f6f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:07.516975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd9910-7d80-407c-8f63-013dd57f6f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:07.517256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd9910-7d80-407c-8f63-013dd57f6f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:07.518051 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd9910-7d80-407c-8f63-013dd57f6f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:07.519931 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd9910-7d80-407c-8f63-013dd57f6f01 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:07.601027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1352/2714] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:16:07 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:16:07.605922 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134c077-9156-4436-981b-a72d617e55fb admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:07.615912 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134c077-9156-4436-981b-a72d617e55fb admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:07.678963 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111878f0-313d-4e1f-853b-7db38fc53530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:07.679750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111878f0-313d-4e1f-853b-7db38fc53530 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:07.680043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111878f0-313d-4e1f-853b-7db38fc53530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:07.680931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111878f0-313d-4e1f-853b-7db38fc53530 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:07.681668 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111878f0-313d-4e1f-853b-7db38fc53530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:07.683677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111878f0-313d-4e1f-853b-7db38fc53530 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:07.782074 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1363/2715] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:16:07 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:16:07.786842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd9910-7d80-407c-8f63-013dd57f6f01 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:07.798083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd9910-7d80-407c-8f63-013dd57f6f01 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:07.802661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989df1a-efee-417d-9ca7-e929f7d7ee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:07.803582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989df1a-efee-417d-9ca7-e929f7d7ee25 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:07.803868 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989df1a-efee-417d-9ca7-e929f7d7ee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:07.804142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989df1a-efee-417d-9ca7-e929f7d7ee25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:07.804859 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989df1a-efee-417d-9ca7-e929f7d7ee25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:07.807425 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989df1a-efee-417d-9ca7-e929f7d7ee25 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:07.819404 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1353/2716] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:16:07.823839 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111878f0-313d-4e1f-853b-7db38fc53530 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:07.833800 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111878f0-313d-4e1f-853b-7db38fc53530 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:07.839012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5dc9e-3fcb-4244-bbca-d4c6f4ad9c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:07.839657 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5dc9e-3fcb-4244-bbca-d4c6f4ad9c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:07.839938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5dc9e-3fcb-4244-bbca-d4c6f4ad9c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:07.840218 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5dc9e-3fcb-4244-bbca-d4c6f4ad9c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:07.840950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5dc9e-3fcb-4244-bbca-d4c6f4ad9c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:07.842951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5dc9e-3fcb-4244-bbca-d4c6f4ad9c49 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:07.862950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1364/2717] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:16:07.864369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989df1a-efee-417d-9ca7-e929f7d7ee25 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:07.875024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989df1a-efee-417d-9ca7-e929f7d7ee25 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:07.879669 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37c6f6-1450-43c5-b852-6c956e9e3c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:07.880556 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37c6f6-1450-43c5-b852-6c956e9e3c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:07.880842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37c6f6-1450-43c5-b852-6c956e9e3c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:07.881122 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37c6f6-1450-43c5-b852-6c956e9e3c15 admin admin] PATH_INFO: `/v3/projects/688814f0af3e42779c0135c97dd257bf/users/be2aa52f98f44909b786ea5a8401cb31/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:07.896457 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37c6f6-1450-43c5-b852-6c956e9e3c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688814f0af3e42779c0135c97dd257bf, user_id=be2aa52f98f44909b786ea5a8401cb31, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:07.899423 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37c6f6-1450-43c5-b852-6c956e9e3c15 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:08.022189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1354/2718] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:16:07 2022] PUT /identity/v3/projects/688814f0af3e42779c0135c97dd257bf/users/be2aa52f98f44909b786ea5a8401cb31/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:16:08.091937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f804e-a0f9-44f0-9454-e357d86a1f12 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:08.092237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f804e-a0f9-44f0-9454-e357d86a1f12 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:08.092520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f804e-a0f9-44f0-9454-e357d86a1f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:08.121332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a98f804e-a0f9-44f0-9454-e357d86a1f12 None None] MFA Rules not processed for user `be2aa52f98f44909b786ea5a8401cb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:08.122480 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a98f804e-a0f9-44f0-9454-e357d86a1f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:08.192574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1365/2719] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:08.204557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37c6f6-1450-43c5-b852-6c956e9e3c15 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:08.206911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8e37c6f6-1450-43c5-b852-6c956e9e3c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:08.268292 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37c6f6-1450-43c5-b852-6c956e9e3c15 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:08.273026 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672234f-e4f4-4f96-9581-fc20d5ae0d98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f8ec4765e05461a98b3c9eb1d3ced5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:08.273708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672234f-e4f4-4f96-9581-fc20d5ae0d98 service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:08.274517 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672234f-e4f4-4f96-9581-fc20d5ae0d98 service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:08.274798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672234f-e4f4-4f96-9581-fc20d5ae0d98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:08.283956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672234f-e4f4-4f96-9581-fc20d5ae0d98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:08.285413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672234f-e4f4-4f96-9581-fc20d5ae0d98 service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:08.295265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1355/2720] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:16:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:16:19.407459 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f804e-a0f9-44f0-9454-e357d86a1f12 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:19.409094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a98f804e-a0f9-44f0-9454-e357d86a1f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:19.482109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f804e-a0f9-44f0-9454-e357d86a1f12 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:19.487852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:19.488731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:19.489022 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:19.489331 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] PATH_INFO: `/v3/users/f2246582720a4c4eb61b4a7e8eb79bc3` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:19.490567 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2246582720a4c4eb61b4a7e8eb79bc3)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:19.492485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:19.676000 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2246582720a4c4eb61b4a7e8eb79bc3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:19.676672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2246582720a4c4eb61b4a7e8eb79bc3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:19.677328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2246582720a4c4eb61b4a7e8eb79bc3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:19.693749 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2246582720a4c4eb61b4a7e8eb79bc3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:19.701001 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2246582720a4c4eb61b4a7e8eb79bc3'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:19.787710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1366/2721] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:16:19 2022] DELETE /identity/v3/users/f2246582720a4c4eb61b4a7e8eb79bc3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:16:19.793343 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed065528-2754-4447-957d-63ce97db456f None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:19.793880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed065528-2754-4447-957d-63ce97db456f None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:19.794002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed065528-2754-4447-957d-63ce97db456f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:19.815418 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ed065528-2754-4447-957d-63ce97db456f None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:19.816652 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ed065528-2754-4447-957d-63ce97db456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:19.879251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1356/2722] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:16:19.890351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:19.891997 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:19.952292 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436b68f-aecc-433e-9e49-5e4668e13770 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:19.955871 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f57abc-1096-4f51-bce0-3f2c8f929350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:19.956518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f57abc-1096-4f51-bce0-3f2c8f929350 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:19.956802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f57abc-1096-4f51-bce0-3f2c8f929350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:19.957082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f57abc-1096-4f51-bce0-3f2c8f929350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:19.966111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f57abc-1096-4f51-bce0-3f2c8f929350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:19.967542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f57abc-1096-4f51-bce0-3f2c8f929350 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:19.976987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1367/2723] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:16:20.429158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed065528-2754-4447-957d-63ce97db456f None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:20.430678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ed065528-2754-4447-957d-63ce97db456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:20.444521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed065528-2754-4447-957d-63ce97db456f None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:20.456060 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:20.456824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:20.457137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:20.457485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] PATH_INFO: `/v3/projects/f56f742dee94447581556206925f0943` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:20.458632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56f742dee94447581556206925f0943)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:20.460625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:20.578164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56f742dee94447581556206925f0943', 'request_id': 'req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:20.584138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56f742dee94447581556206925f0943', 'request_id': 'req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:20.656277 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56f742dee94447581556206925f0943', 'request_id': 'req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:20.668356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] The token cache is being invalidate because project f56f742dee94447581556206925f0943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:16:20.668651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:20.669351 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-ad3aa729-e53b-4daf-8fe7-c1655a96bad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:20.670981 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1357/2724] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:16:20 2022] DELETE /identity/v3/projects/f56f742dee94447581556206925f0943 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:16:20.676026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf5193-6df0-4372-b289-0d4155c26133 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:20.676522 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf5193-6df0-4372-b289-0d4155c26133 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:20.676677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf5193-6df0-4372-b289-0d4155c26133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:20.707395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-7fcf5193-6df0-4372-b289-0d4155c26133 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:20.708539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7fcf5193-6df0-4372-b289-0d4155c26133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:20.767580 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1368/2725] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:20.775534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6aa68-f054-4f09-9f5b-2eb44f0e60e3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:20.775831 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6aa68-f054-4f09-9f5b-2eb44f0e60e3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:20.776320 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6aa68-f054-4f09-9f5b-2eb44f0e60e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:20.794526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8cf6aa68-f054-4f09-9f5b-2eb44f0e60e3 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:20.795732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8cf6aa68-f054-4f09-9f5b-2eb44f0e60e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:20.803707 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1358/2726] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:20.808620 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf5193-6df0-4372-b289-0d4155c26133 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:20.818257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf5193-6df0-4372-b289-0d4155c26133 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:20.823661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c32219-4183-46ae-a220-a318bd09ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:20.824334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c32219-4183-46ae-a220-a318bd09ff18 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:20.824619 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c32219-4183-46ae-a220-a318bd09ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:20.824897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c32219-4183-46ae-a220-a318bd09ff18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:20.825661 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c32219-4183-46ae-a220-a318bd09ff18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:16:20.825969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c32219-4183-46ae-a220-a318bd09ff18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:20.827550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c32219-4183-46ae-a220-a318bd09ff18 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:20.839361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1369/2727] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:16:20.843992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6aa68-f054-4f09-9f5b-2eb44f0e60e3 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:20.853353 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6aa68-f054-4f09-9f5b-2eb44f0e60e3 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:20.859003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1be8a-8f09-49fc-822c-7f667f5364bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:20.859680 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1be8a-8f09-49fc-822c-7f667f5364bd admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:20.860213 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1be8a-8f09-49fc-822c-7f667f5364bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:20.860213 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1be8a-8f09-49fc-822c-7f667f5364bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:20.860941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1be8a-8f09-49fc-822c-7f667f5364bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:20.862884 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1be8a-8f09-49fc-822c-7f667f5364bd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:20.960897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1359/2728] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:16:20 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:16:20.965346 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c32219-4183-46ae-a220-a318bd09ff18 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:20.975414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c32219-4183-46ae-a220-a318bd09ff18 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:21.032958 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9706865-1093-4d8e-b5ff-a4e4215ee1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:21.033752 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9706865-1093-4d8e-b5ff-a4e4215ee1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:21.034046 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9706865-1093-4d8e-b5ff-a4e4215ee1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:21.034328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9706865-1093-4d8e-b5ff-a4e4215ee1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:21.035019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9706865-1093-4d8e-b5ff-a4e4215ee1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:21.036926 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9706865-1093-4d8e-b5ff-a4e4215ee1c9 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:21.170842 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1370/2729] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:16:20 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:16:21.174996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1be8a-8f09-49fc-822c-7f667f5364bd admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:21.186019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1be8a-8f09-49fc-822c-7f667f5364bd admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:21.190731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2ec8-3871-4299-a255-89b5f425aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:21.191433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2ec8-3871-4299-a255-89b5f425aea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:21.191739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2ec8-3871-4299-a255-89b5f425aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:21.192018 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2ec8-3871-4299-a255-89b5f425aea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:21.192816 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2ec8-3871-4299-a255-89b5f425aea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:21.194426 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2ec8-3871-4299-a255-89b5f425aea8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:21.205961 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1360/2730] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:16:21.209939 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9706865-1093-4d8e-b5ff-a4e4215ee1c9 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:21.220786 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9706865-1093-4d8e-b5ff-a4e4215ee1c9 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:21.225302 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffda28-7a36-4509-85be-0496cb7a2246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:21.225980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffda28-7a36-4509-85be-0496cb7a2246 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:21.226262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffda28-7a36-4509-85be-0496cb7a2246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:21.226536 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffda28-7a36-4509-85be-0496cb7a2246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:21.227257 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffda28-7a36-4509-85be-0496cb7a2246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:21.228838 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffda28-7a36-4509-85be-0496cb7a2246 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:21.238870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1371/2731] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:16:21.242992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2ec8-3871-4299-a255-89b5f425aea8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:21.253054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2ec8-3871-4299-a255-89b5f425aea8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:21.257547 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae07fc-046c-4988-9e8d-d4a8c0dc9609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:21.258421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae07fc-046c-4988-9e8d-d4a8c0dc9609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:21.258714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae07fc-046c-4988-9e8d-d4a8c0dc9609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:21.258985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae07fc-046c-4988-9e8d-d4a8c0dc9609 admin admin] PATH_INFO: `/v3/projects/d3370b4305494579958893bf521717f9/users/55bcc8b701cc442e9f91df3b8cbeb8e1/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:21.273947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae07fc-046c-4988-9e8d-d4a8c0dc9609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3370b4305494579958893bf521717f9, user_id=55bcc8b701cc442e9f91df3b8cbeb8e1, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:21.276552 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae07fc-046c-4988-9e8d-d4a8c0dc9609 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:21.336955 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1361/2732] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:16:21 2022] PUT /identity/v3/projects/d3370b4305494579958893bf521717f9/users/55bcc8b701cc442e9f91df3b8cbeb8e1/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:16:21.348077 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b6c6-3768-4f72-8e9e-449688ed8256 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:21.348369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b6c6-3768-4f72-8e9e-449688ed8256 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:21.348650 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b6c6-3768-4f72-8e9e-449688ed8256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:21.376678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-ca58b6c6-3768-4f72-8e9e-449688ed8256 None None] MFA Rules not processed for user `55bcc8b701cc442e9f91df3b8cbeb8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:21.385058 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ca58b6c6-3768-4f72-8e9e-449688ed8256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:21.446042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1372/2733] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:21.458259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae07fc-046c-4988-9e8d-d4a8c0dc9609 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:21.459957 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-28ae07fc-046c-4988-9e8d-d4a8c0dc9609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:21.525927 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae07fc-046c-4988-9e8d-d4a8c0dc9609 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:21.529952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3ce2d-d07f-4398-bac8-b81800086d8b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f8ec4765e05461a98b3c9eb1d3ced5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:21.530888 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ce2d-d07f-4398-bac8-b81800086d8b service glance] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:21.531094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ce2d-d07f-4398-bac8-b81800086d8b service glance] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:21.531391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3ce2d-d07f-4398-bac8-b81800086d8b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:21.539901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3ce2d-d07f-4398-bac8-b81800086d8b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:21.541387 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3ce2d-d07f-4398-bac8-b81800086d8b service glance] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:21.550339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1362/2734] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:16:33.511623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58b6c6-3768-4f72-8e9e-449688ed8256 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:33.513672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-ca58b6c6-3768-4f72-8e9e-449688ed8256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:33.574262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58b6c6-3768-4f72-8e9e-449688ed8256 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:33.579457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e990ec1-718a-442d-b422-8934e74de533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:33.580117 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e990ec1-718a-442d-b422-8934e74de533 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:33.580400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e990ec1-718a-442d-b422-8934e74de533 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:33.580707 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e990ec1-718a-442d-b422-8934e74de533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:33.582556 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0e990ec1-718a-442d-b422-8934e74de533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:33.642753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e990ec1-718a-442d-b422-8934e74de533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:33.644375 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e990ec1-718a-442d-b422-8934e74de533 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:33.654321 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1373/2735] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:16:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:16:57.063081 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3ce2d-d07f-4398-bac8-b81800086d8b service glance] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:57.064594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-93c3ce2d-d07f-4398-bac8-b81800086d8b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:57.177907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3ce2d-d07f-4398-bac8-b81800086d8b service glance] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:57.182576 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:57.183310 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:57.183594 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:57.183874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] PATH_INFO: `/v3/users/be2aa52f98f44909b786ea5a8401cb31` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:57.185067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2aa52f98f44909b786ea5a8401cb31)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:57.187078 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:57.372602 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2aa52f98f44909b786ea5a8401cb31'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:57.385186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2aa52f98f44909b786ea5a8401cb31'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:57.386029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2aa52f98f44909b786ea5a8401cb31'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:57.484683 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2aa52f98f44909b786ea5a8401cb31'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:57.492212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2aa52f98f44909b786ea5a8401cb31'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:57.498170 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1363/2736] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:16:57 2022] DELETE /identity/v3/users/be2aa52f98f44909b786ea5a8401cb31 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:16:57.502793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb94ae-4a3c-4f03-8dcb-d08a3c97c8ca None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:57.503322 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb94ae-4a3c-4f03-8dcb-d08a3c97c8ca None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:57.503434 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb94ae-4a3c-4f03-8dcb-d08a3c97c8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:57.522573 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-08bb94ae-4a3c-4f03-8dcb-d08a3c97c8ca None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:57.525518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-08bb94ae-4a3c-4f03-8dcb-d08a3c97c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:57.585770 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1374/2737] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:57.595383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:57.597526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:57.659876 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c08dc-54b9-4370-b647-b444aa0bd6d7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:57.663905 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a0aca-5bcc-4122-abcc-52eedea717f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:57.668693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a0aca-5bcc-4122-abcc-52eedea717f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:57.668693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a0aca-5bcc-4122-abcc-52eedea717f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:57.668693 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a0aca-5bcc-4122-abcc-52eedea717f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:57.675157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a0aca-5bcc-4122-abcc-52eedea717f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:57.676573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a0aca-5bcc-4122-abcc-52eedea717f8 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:57.685976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1364/2738] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:16:58.166595 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb94ae-4a3c-4f03-8dcb-d08a3c97c8ca None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:58.167999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-08bb94ae-4a3c-4f03-8dcb-d08a3c97c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:58.180747 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb94ae-4a3c-4f03-8dcb-d08a3c97c8ca None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:58.185524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:58.186417 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:58.191911 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:58.192356 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] PATH_INFO: `/v3/projects/688814f0af3e42779c0135c97dd257bf` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:58.193753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=688814f0af3e42779c0135c97dd257bf)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:58.195674 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:58.307954 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688814f0af3e42779c0135c97dd257bf', 'request_id': 'req-213804db-630b-48ab-9b94-540c65d35fbe'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:58.313328 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688814f0af3e42779c0135c97dd257bf', 'request_id': 'req-213804db-630b-48ab-9b94-540c65d35fbe'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:58.398918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688814f0af3e42779c0135c97dd257bf', 'request_id': 'req-213804db-630b-48ab-9b94-540c65d35fbe'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:58.410921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] The token cache is being invalidate because project 688814f0af3e42779c0135c97dd257bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:16:58.411216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:58.411884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-213804db-630b-48ab-9b94-540c65d35fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:58.413608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1375/2739] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:16:58 2022] DELETE /identity/v3/projects/688814f0af3e42779c0135c97dd257bf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:16:58.419188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9bc13-5b68-45af-bc26-6bc2d6aadd96 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:58.419704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9bc13-5b68-45af-bc26-6bc2d6aadd96 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:58.419704 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9bc13-5b68-45af-bc26-6bc2d6aadd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:58.438582 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-5ab9bc13-5b68-45af-bc26-6bc2d6aadd96 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:58.439875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-5ab9bc13-5b68-45af-bc26-6bc2d6aadd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:58.506232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1365/2740] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:58.514033 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872390dc-dcfb-4410-a6a2-6ef3200a3f1e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:58.514554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872390dc-dcfb-4410-a6a2-6ef3200a3f1e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:58.514682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872390dc-dcfb-4410-a6a2-6ef3200a3f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:58.533265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-872390dc-dcfb-4410-a6a2-6ef3200a3f1e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:58.535150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-872390dc-dcfb-4410-a6a2-6ef3200a3f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:58.543225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1376/2741] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:58.547548 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9bc13-5b68-45af-bc26-6bc2d6aadd96 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:58.558118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9bc13-5b68-45af-bc26-6bc2d6aadd96 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:58.562959 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1a558-187b-4a48-ab89-3fdc049e99f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:58.563616 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1a558-187b-4a48-ab89-3fdc049e99f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:58.563899 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1a558-187b-4a48-ab89-3fdc049e99f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:58.564176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1a558-187b-4a48-ab89-3fdc049e99f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:58.564904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1a558-187b-4a48-ab89-3fdc049e99f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:16:58.565258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1a558-187b-4a48-ab89-3fdc049e99f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:58.566880 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1a558-187b-4a48-ab89-3fdc049e99f0 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:58.578217 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1366/2742] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:16:58.583255 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872390dc-dcfb-4410-a6a2-6ef3200a3f1e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:58.592723 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872390dc-dcfb-4410-a6a2-6ef3200a3f1e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:58.597872 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cba2a-1d8a-4c08-bd40-ac2fc9567619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:58.598532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cba2a-1d8a-4c08-bd40-ac2fc9567619 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:58.598820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cba2a-1d8a-4c08-bd40-ac2fc9567619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:58.599106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cba2a-1d8a-4c08-bd40-ac2fc9567619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:58.599801 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cba2a-1d8a-4c08-bd40-ac2fc9567619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:58.601735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cba2a-1d8a-4c08-bd40-ac2fc9567619 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:58.686884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1377/2743] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:16:58 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:16:58.691290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1a558-187b-4a48-ab89-3fdc049e99f0 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:58.704610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1a558-187b-4a48-ab89-3fdc049e99f0 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:58.764098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f2a2d-d4bb-49bc-b25d-49ebfa6cd07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:58.764771 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f2a2d-d4bb-49bc-b25d-49ebfa6cd07a admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:58.765069 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f2a2d-d4bb-49bc-b25d-49ebfa6cd07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:58.765377 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f2a2d-d4bb-49bc-b25d-49ebfa6cd07a admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:58.766080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f2a2d-d4bb-49bc-b25d-49ebfa6cd07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:58.767964 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f2a2d-d4bb-49bc-b25d-49ebfa6cd07a admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:58.856152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1367/2744] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:16:58 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:16:58.860395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cba2a-1d8a-4c08-bd40-ac2fc9567619 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:58.871896 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cba2a-1d8a-4c08-bd40-ac2fc9567619 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:58.876553 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc53a2f-bee5-4246-ab4d-6ba0b9cc0299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:58.877225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc53a2f-bee5-4246-ab4d-6ba0b9cc0299 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:58.882910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc53a2f-bee5-4246-ab4d-6ba0b9cc0299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:58.882910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc53a2f-bee5-4246-ab4d-6ba0b9cc0299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:58.882910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc53a2f-bee5-4246-ab4d-6ba0b9cc0299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:58.882910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc53a2f-bee5-4246-ab4d-6ba0b9cc0299 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:58.892042 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1378/2745] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:16:58.896240 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f2a2d-d4bb-49bc-b25d-49ebfa6cd07a admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:58.908302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f2a2d-d4bb-49bc-b25d-49ebfa6cd07a admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:58.913163 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0429d82-054e-4aca-ac18-4423b3ddeabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:58.913862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0429d82-054e-4aca-ac18-4423b3ddeabd admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:58.914150 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0429d82-054e-4aca-ac18-4423b3ddeabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:58.914435 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0429d82-054e-4aca-ac18-4423b3ddeabd admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:58.915169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0429d82-054e-4aca-ac18-4423b3ddeabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:58.916907 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0429d82-054e-4aca-ac18-4423b3ddeabd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:58.929871 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1368/2746] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:16:58.934016 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc53a2f-bee5-4246-ab4d-6ba0b9cc0299 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:58.944890 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc53a2f-bee5-4246-ab4d-6ba0b9cc0299 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:58.949501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd7dbe-ec6b-42b2-bdd3-726b724ed66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:58.950378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd7dbe-ec6b-42b2-bdd3-726b724ed66d admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:58.950662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd7dbe-ec6b-42b2-bdd3-726b724ed66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:58.950938 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd7dbe-ec6b-42b2-bdd3-726b724ed66d admin admin] PATH_INFO: `/v3/projects/855aadf410184f3bb65f47d6253a6164/users/524c418991b146f3b600f3f3b2099869/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:58.965638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd7dbe-ec6b-42b2-bdd3-726b724ed66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=855aadf410184f3bb65f47d6253a6164, user_id=524c418991b146f3b600f3f3b2099869, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:58.969048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd7dbe-ec6b-42b2-bdd3-726b724ed66d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:59.052913 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1379/2747] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:16:58 2022] PUT /identity/v3/projects/855aadf410184f3bb65f47d6253a6164/users/524c418991b146f3b600f3f3b2099869/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:16:59.063975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921fc29-8182-4ee1-bd1d-3c392069ffdb None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:59.064272 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921fc29-8182-4ee1-bd1d-3c392069ffdb None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:59.064559 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921fc29-8182-4ee1-bd1d-3c392069ffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:59.091940 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2921fc29-8182-4ee1-bd1d-3c392069ffdb None None] MFA Rules not processed for user `524c418991b146f3b600f3f3b2099869`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:59.093144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2921fc29-8182-4ee1-bd1d-3c392069ffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:59.156029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1369/2748] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:59.167818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd7dbe-ec6b-42b2-bdd3-726b724ed66d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:59.169965 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-66bd7dbe-ec6b-42b2-bdd3-726b724ed66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:59.229659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd7dbe-ec6b-42b2-bdd3-726b724ed66d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:59.233435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f427f1-0ec4-4c65-a696-d42e6f29f81c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:59.234095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f427f1-0ec4-4c65-a696-d42e6f29f81c service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:59.234382 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f427f1-0ec4-4c65-a696-d42e6f29f81c service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:59.234663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f427f1-0ec4-4c65-a696-d42e6f29f81c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:59.244214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f427f1-0ec4-4c65-a696-d42e6f29f81c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:59.245682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f427f1-0ec4-4c65-a696-d42e6f29f81c service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:59.254689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1380/2749] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:16:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:16:59.435340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921fc29-8182-4ee1-bd1d-3c392069ffdb None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:59.437013 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2921fc29-8182-4ee1-bd1d-3c392069ffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:59.503835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921fc29-8182-4ee1-bd1d-3c392069ffdb None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:16:59.508424 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:16:59.509324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:59.509612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:59.509889 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] PATH_INFO: `/v3/users/55bcc8b701cc442e9f91df3b8cbeb8e1` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:59.511068 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bcc8b701cc442e9f91df3b8cbeb8e1)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:16:59.512964 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:16:59.728557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bcc8b701cc442e9f91df3b8cbeb8e1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:59.740811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bcc8b701cc442e9f91df3b8cbeb8e1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:59.741603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bcc8b701cc442e9f91df3b8cbeb8e1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:59.828206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bcc8b701cc442e9f91df3b8cbeb8e1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:59.836968 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bcc8b701cc442e9f91df3b8cbeb8e1'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:16:59.843095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1370/2750] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:16:59 2022] DELETE /identity/v3/users/55bcc8b701cc442e9f91df3b8cbeb8e1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:16:59.847962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b8bb6-c810-4e7b-a1b9-2a71f82ba61b None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:16:59.848463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b8bb6-c810-4e7b-a1b9-2a71f82ba61b None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:16:59.848662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b8bb6-c810-4e7b-a1b9-2a71f82ba61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:16:59.870373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-b08b8bb6-c810-4e7b-a1b9-2a71f82ba61b None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:16:59.871444 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b08b8bb6-c810-4e7b-a1b9-2a71f82ba61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:16:59.930457 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1381/2751] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:16:59.940399 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:16:59.942856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:00.006209 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84b829-bbc7-46d1-bfd5-3f854d405e86 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:00.009838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ef91f-7ae2-4abf-a088-48a35c76f7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:00.010489 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ef91f-7ae2-4abf-a088-48a35c76f7dd service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:00.010775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ef91f-7ae2-4abf-a088-48a35c76f7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:00.011055 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ef91f-7ae2-4abf-a088-48a35c76f7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:00.021454 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ef91f-7ae2-4abf-a088-48a35c76f7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:00.023149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ef91f-7ae2-4abf-a088-48a35c76f7dd service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:00.033110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1371/2752] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:17:00.447651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b8bb6-c810-4e7b-a1b9-2a71f82ba61b None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:00.449232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b08b8bb6-c810-4e7b-a1b9-2a71f82ba61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:00.463920 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b8bb6-c810-4e7b-a1b9-2a71f82ba61b None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:00.469677 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:00.471336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:00.471733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:00.472334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] PATH_INFO: `/v3/projects/d3370b4305494579958893bf521717f9` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:00.482012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3370b4305494579958893bf521717f9)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:00.482012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:00.594214 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3370b4305494579958893bf521717f9', 'request_id': 'req-d97629ad-ee06-4738-bf67-7ce61f6e36e8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:00.600343 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3370b4305494579958893bf521717f9', 'request_id': 'req-d97629ad-ee06-4738-bf67-7ce61f6e36e8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:00.724845 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3370b4305494579958893bf521717f9', 'request_id': 'req-d97629ad-ee06-4738-bf67-7ce61f6e36e8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:00.736505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] The token cache is being invalidate because project d3370b4305494579958893bf521717f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:17:00.736802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:00.737511 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:00.740028 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1382/2753] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:17:00 2022] DELETE /identity/v3/projects/d3370b4305494579958893bf521717f9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:17:09.061570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ef91f-7ae2-4abf-a088-48a35c76f7dd service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:09.070223 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ef91f-7ae2-4abf-a088-48a35c76f7dd service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:09.119936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d66e0-c624-41a3-870a-117319ccf670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:09.120603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d66e0-c624-41a3-870a-117319ccf670 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:09.120893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d66e0-c624-41a3-870a-117319ccf670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:09.121210 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d66e0-c624-41a3-870a-117319ccf670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:09.123074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f79d66e0-c624-41a3-870a-117319ccf670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:09.185044 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d66e0-c624-41a3-870a-117319ccf670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:09.186528 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d66e0-c624-41a3-870a-117319ccf670 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:09.196319 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1372/2754] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:17:09.892055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:09.894338 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:09.910934 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97629ad-ee06-4738-bf67-7ce61f6e36e8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:09.917163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:09.918118 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:09.918412 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:09.918698 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] PATH_INFO: `/v3/users/b4df001beaca4de2a8e15c26b31a9168` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:09.920514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4df001beaca4de2a8e15c26b31a9168)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:09.922521 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:10.126713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4df001beaca4de2a8e15c26b31a9168'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.127383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4df001beaca4de2a8e15c26b31a9168'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.127992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4df001beaca4de2a8e15c26b31a9168'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.139970 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4df001beaca4de2a8e15c26b31a9168'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.146711 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4df001beaca4de2a8e15c26b31a9168'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.244943 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1383/2755] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:17:09 2022] DELETE /identity/v3/users/b4df001beaca4de2a8e15c26b31a9168 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:17:10.480882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d66e0-c624-41a3-870a-117319ccf670 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:10.490709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d66e0-c624-41a3-870a-117319ccf670 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:10.551466 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:10.552355 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:10.552638 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:10.552913 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] PATH_INFO: `/v3/projects/fd3f403a1bdf48db8bec832b39b8f391` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:10.554146 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd3f403a1bdf48db8bec832b39b8f391)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:10.556176 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:10.659133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd3f403a1bdf48db8bec832b39b8f391', 'request_id': 'req-8423ed7d-4eff-49a3-8a76-5e26b981877b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.665318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd3f403a1bdf48db8bec832b39b8f391', 'request_id': 'req-8423ed7d-4eff-49a3-8a76-5e26b981877b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.684265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:10.685703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:10.703806 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e2cd0-4ac7-4e06-a679-5bf2b2503d2c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:10.730467 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd3f403a1bdf48db8bec832b39b8f391', 'request_id': 'req-8423ed7d-4eff-49a3-8a76-5e26b981877b'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.743200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] The token cache is being invalidate because project fd3f403a1bdf48db8bec832b39b8f391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:17:10.743493 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.744158 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-8423ed7d-4eff-49a3-8a76-5e26b981877b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.747180 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1373/2756] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:17:10 2022] DELETE /identity/v3/projects/fd3f403a1bdf48db8bec832b39b8f391 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:17:10.765012 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:10.766340 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:10.766630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:10.766915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] PATH_INFO: `/v3/users/524c418991b146f3b600f3f3b2099869` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:10.768275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] RBAC: Authorizing `identity:delete_user(user_id=524c418991b146f3b600f3f3b2099869)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:10.770321 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:10.991199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524c418991b146f3b600f3f3b2099869'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.992564 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524c418991b146f3b600f3f3b2099869'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:10.993527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524c418991b146f3b600f3f3b2099869'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:11.005149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524c418991b146f3b600f3f3b2099869'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:11.012879 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524c418991b146f3b600f3f3b2099869'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:11.084790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1384/2757] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:17:10 2022] DELETE /identity/v3/users/524c418991b146f3b600f3f3b2099869 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:17:11.089569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73220ba6-2da2-4fa6-b84c-999c1fcd20b5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:11.089862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73220ba6-2da2-4fa6-b84c-999c1fcd20b5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:11.090142 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73220ba6-2da2-4fa6-b84c-999c1fcd20b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:11.108532 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-73220ba6-2da2-4fa6-b84c-999c1fcd20b5 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:17:11.109766 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-73220ba6-2da2-4fa6-b84c-999c1fcd20b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:11.172151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1374/2758] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:17:11.183155 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:11.184751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:11.243209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355d4f5-174a-4e9a-ae2b-8af13bf1511d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:11.246843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abfe1f6-1eda-44d7-96ea-7ed6a58518f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:11.247490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe1f6-1eda-44d7-96ea-7ed6a58518f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:11.247777 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe1f6-1eda-44d7-96ea-7ed6a58518f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:11.248057 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe1f6-1eda-44d7-96ea-7ed6a58518f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:11.257498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abfe1f6-1eda-44d7-96ea-7ed6a58518f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:11.258919 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abfe1f6-1eda-44d7-96ea-7ed6a58518f5 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:11.268228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1385/2759] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:17:11.726948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73220ba6-2da2-4fa6-b84c-999c1fcd20b5 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:11.728538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-73220ba6-2da2-4fa6-b84c-999c1fcd20b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:11.741102 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73220ba6-2da2-4fa6-b84c-999c1fcd20b5 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:11.747711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:11.748600 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:11.748888 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:11.749173 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] PATH_INFO: `/v3/projects/855aadf410184f3bb65f47d6253a6164` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:11.750469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855aadf410184f3bb65f47d6253a6164)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:11.752409 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:11.850851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855aadf410184f3bb65f47d6253a6164', 'request_id': 'req-256a9b03-c5a4-4e55-a910-e101cf5ce098'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:11.857197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855aadf410184f3bb65f47d6253a6164', 'request_id': 'req-256a9b03-c5a4-4e55-a910-e101cf5ce098'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:11.924727 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855aadf410184f3bb65f47d6253a6164', 'request_id': 'req-256a9b03-c5a4-4e55-a910-e101cf5ce098'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:11.936460 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] The token cache is being invalidate because project 855aadf410184f3bb65f47d6253a6164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:17:11.936777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:11.937451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-256a9b03-c5a4-4e55-a910-e101cf5ce098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:17:11.939000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1375/2760] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:17:11 2022] DELETE /identity/v3/projects/855aadf410184f3bb65f47d6253a6164 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:17:11.951337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bb20c-143c-475c-b06c-0389c1b355d6 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:11.951653 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bb20c-143c-475c-b06c-0389c1b355d6 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:11.951935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bb20c-143c-475c-b06c-0389c1b355d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:11.971863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-044bb20c-143c-475c-b06c-0389c1b355d6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:17:11.973076 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-044bb20c-143c-475c-b06c-0389c1b355d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:12.036637 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1386/2761] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:17:12.044909 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c398917-0048-40be-b074-63f4282ad01d None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:12.045206 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c398917-0048-40be-b074-63f4282ad01d None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:12.045521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c398917-0048-40be-b074-63f4282ad01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:12.064359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-3c398917-0048-40be-b074-63f4282ad01d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:17:12.065596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3c398917-0048-40be-b074-63f4282ad01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:12.074259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1376/2762] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:17:12.078586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bb20c-143c-475c-b06c-0389c1b355d6 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:12.089184 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bb20c-143c-475c-b06c-0389c1b355d6 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:12.093812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee096-ca61-405a-a846-da56cddbba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:12.094820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee096-ca61-405a-a846-da56cddbba03 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:12.094820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee096-ca61-405a-a846-da56cddbba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:12.095061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee096-ca61-405a-a846-da56cddbba03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:12.095754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aee096-ca61-405a-a846-da56cddbba03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:17:12.096065 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aee096-ca61-405a-a846-da56cddbba03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:12.097775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aee096-ca61-405a-a846-da56cddbba03 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:12.109916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1387/2763] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:17:12.114038 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c398917-0048-40be-b074-63f4282ad01d None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:12.124664 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c398917-0048-40be-b074-63f4282ad01d None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:12.129341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0769-3b2f-41f7-a574-75a5ab71117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:12.130000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0769-3b2f-41f7-a574-75a5ab71117d admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:12.130288 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0769-3b2f-41f7-a574-75a5ab71117d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:12.130569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0769-3b2f-41f7-a574-75a5ab71117d admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:12.131275 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def0769-3b2f-41f7-a574-75a5ab71117d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:12.133822 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def0769-3b2f-41f7-a574-75a5ab71117d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:12.246535 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1377/2764] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:17:12 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:17:12.250846 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee096-ca61-405a-a846-da56cddbba03 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:12.261688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee096-ca61-405a-a846-da56cddbba03 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:12.316998 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3b6f1-55bf-4a34-bf80-0a621f357a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:12.317605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3b6f1-55bf-4a34-bf80-0a621f357a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:12.317890 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3b6f1-55bf-4a34-bf80-0a621f357a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:12.318170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3b6f1-55bf-4a34-bf80-0a621f357a96 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:12.318856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3b6f1-55bf-4a34-bf80-0a621f357a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:12.321470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3b6f1-55bf-4a34-bf80-0a621f357a96 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:12.410317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1388/2765] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:17:12 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:17:12.414771 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0769-3b2f-41f7-a574-75a5ab71117d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:12.427349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0769-3b2f-41f7-a574-75a5ab71117d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:12.434085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c9276-48dc-47c0-9e1a-68898a50b184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:12.434875 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9276-48dc-47c0-9e1a-68898a50b184 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:12.435165 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9276-48dc-47c0-9e1a-68898a50b184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:12.435451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c9276-48dc-47c0-9e1a-68898a50b184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:12.436298 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c9276-48dc-47c0-9e1a-68898a50b184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:12.437988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c9276-48dc-47c0-9e1a-68898a50b184 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:12.452974 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1378/2766] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:17:12.457539 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3b6f1-55bf-4a34-bf80-0a621f357a96 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:12.468609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3b6f1-55bf-4a34-bf80-0a621f357a96 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:12.473731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aad171-b6fb-4340-be75-7287ad55c727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:12.474407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad171-b6fb-4340-be75-7287ad55c727 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:12.474737 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad171-b6fb-4340-be75-7287ad55c727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:12.475024 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad171-b6fb-4340-be75-7287ad55c727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:12.475797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aad171-b6fb-4340-be75-7287ad55c727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:12.478870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aad171-b6fb-4340-be75-7287ad55c727 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:12.490482 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1389/2767] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:17:12.501732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c9276-48dc-47c0-9e1a-68898a50b184 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:12.515563 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c9276-48dc-47c0-9e1a-68898a50b184 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:12.520601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb264a-dec2-4872-8c9a-606f55a51c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:12.521585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb264a-dec2-4872-8c9a-606f55a51c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:12.521852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb264a-dec2-4872-8c9a-606f55a51c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:12.522341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb264a-dec2-4872-8c9a-606f55a51c34 admin admin] PATH_INFO: `/v3/projects/d32287a21bed4346ae982132d4f29764/users/ce3a8645c67e438f8f4e6aa933daeb26/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:12.540110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb264a-dec2-4872-8c9a-606f55a51c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32287a21bed4346ae982132d4f29764, user_id=ce3a8645c67e438f8f4e6aa933daeb26, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:12.543012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb264a-dec2-4872-8c9a-606f55a51c34 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:12.645364 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1379/2768] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:17:12 2022] PUT /identity/v3/projects/d32287a21bed4346ae982132d4f29764/users/ce3a8645c67e438f8f4e6aa933daeb26/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:17:12.651252 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f3060-f0a6-48ab-8726-6afbf0cfda69 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:12.651546 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f3060-f0a6-48ab-8726-6afbf0cfda69 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:12.651833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f3060-f0a6-48ab-8726-6afbf0cfda69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:12.670609 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-db2f3060-f0a6-48ab-8726-6afbf0cfda69 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:17:12.673718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-db2f3060-f0a6-48ab-8726-6afbf0cfda69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:12.730391 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1390/2769] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:17:12.740873 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb264a-dec2-4872-8c9a-606f55a51c34 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:12.743212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-98bb264a-dec2-4872-8c9a-606f55a51c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:12.800996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb264a-dec2-4872-8c9a-606f55a51c34 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:12.805901 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c67ad0-1169-4682-88fa-fbccb7cf513c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:12.806569 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c67ad0-1169-4682-88fa-fbccb7cf513c service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:12.806858 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c67ad0-1169-4682-88fa-fbccb7cf513c service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:12.807138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c67ad0-1169-4682-88fa-fbccb7cf513c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:12.816812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c67ad0-1169-4682-88fa-fbccb7cf513c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:12.818262 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c67ad0-1169-4682-88fa-fbccb7cf513c service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:12.828398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1380/2770] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:17:18.573979 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7343e6-3991-4209-a717-45e7a68d0582 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:18.574506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7343e6-3991-4209-a717-45e7a68d0582 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:18.574506 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7343e6-3991-4209-a717-45e7a68d0582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:18.604205 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-1f7343e6-3991-4209-a717-45e7a68d0582 None None] MFA Rules not processed for user `ce3a8645c67e438f8f4e6aa933daeb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:17:18.605772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-1f7343e6-3991-4209-a717-45e7a68d0582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:18.674975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1391/2771] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:17:18.680783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c67ad0-1169-4682-88fa-fbccb7cf513c service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:18.690619 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c67ad0-1169-4682-88fa-fbccb7cf513c service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:18.696079 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c521992-7903-40b7-896c-cf5262e23edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:18.696804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521992-7903-40b7-896c-cf5262e23edc admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:18.697094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521992-7903-40b7-896c-cf5262e23edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:18.697410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521992-7903-40b7-896c-cf5262e23edc admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:18.698126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c521992-7903-40b7-896c-cf5262e23edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:18.700010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c521992-7903-40b7-896c-cf5262e23edc admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:18.789349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1381/2772] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:17:18 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:17:18.793379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7343e6-3991-4209-a717-45e7a68d0582 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:18.804932 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7343e6-3991-4209-a717-45e7a68d0582 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:18.864746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fb0d7-4019-42ac-80d0-b55925cf1e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:18.865169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fb0d7-4019-42ac-80d0-b55925cf1e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:18.865498 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fb0d7-4019-42ac-80d0-b55925cf1e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:18.865804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fb0d7-4019-42ac-80d0-b55925cf1e45 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:18.866835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fb0d7-4019-42ac-80d0-b55925cf1e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:18.868472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fb0d7-4019-42ac-80d0-b55925cf1e45 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:18.930797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1392/2773] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:17:18 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:17:18.934718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c521992-7903-40b7-896c-cf5262e23edc admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:18.945074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c521992-7903-40b7-896c-cf5262e23edc admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:18.950223 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678f543-ab51-4c04-8b89-1409d39dc79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:18.950895 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678f543-ab51-4c04-8b89-1409d39dc79e admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:18.951211 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678f543-ab51-4c04-8b89-1409d39dc79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:18.951491 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678f543-ab51-4c04-8b89-1409d39dc79e admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:18.952254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678f543-ab51-4c04-8b89-1409d39dc79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:18.953978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678f543-ab51-4c04-8b89-1409d39dc79e admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:18.965381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1382/2774] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:17:18.969523 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fb0d7-4019-42ac-80d0-b55925cf1e45 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:18.980594 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fb0d7-4019-42ac-80d0-b55925cf1e45 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:18.985362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac34c4-20c3-473e-8879-783295cd020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:18.986287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac34c4-20c3-473e-8879-783295cd020c admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:18.986573 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac34c4-20c3-473e-8879-783295cd020c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:18.986852 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac34c4-20c3-473e-8879-783295cd020c admin admin] PATH_INFO: `/v3/projects/fc343c4856bf4b16963e9761c9b8e95f/users/496be8ef31484b979cd5125f3e0c5c93/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:19.003075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac34c4-20c3-473e-8879-783295cd020c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc343c4856bf4b16963e9761c9b8e95f, user_id=496be8ef31484b979cd5125f3e0c5c93, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:19.005780 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac34c4-20c3-473e-8879-783295cd020c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:19.103090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1393/2775] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:17:18 2022] PUT /identity/v3/projects/fc343c4856bf4b16963e9761c9b8e95f/users/496be8ef31484b979cd5125f3e0c5c93/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:17:19.107157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678f543-ab51-4c04-8b89-1409d39dc79e admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:19.117671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678f543-ab51-4c04-8b89-1409d39dc79e admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:19.178465 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5054b67-77fc-4190-a855-024ed40bd81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:19.179293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5054b67-77fc-4190-a855-024ed40bd81b admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:19.179612 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5054b67-77fc-4190-a855-024ed40bd81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:19.179922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5054b67-77fc-4190-a855-024ed40bd81b admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:19.180668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5054b67-77fc-4190-a855-024ed40bd81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:19.182337 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5054b67-77fc-4190-a855-024ed40bd81b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:19.193011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1383/2776] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:17:19.198303 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac34c4-20c3-473e-8879-783295cd020c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:19.208960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac34c4-20c3-473e-8879-783295cd020c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:19.214613 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755eddc-fdf1-44aa-b432-62a7662e17ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:19.215512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755eddc-fdf1-44aa-b432-62a7662e17ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:19.215805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755eddc-fdf1-44aa-b432-62a7662e17ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:19.216087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755eddc-fdf1-44aa-b432-62a7662e17ee admin admin] PATH_INFO: `/v3/projects/fc343c4856bf4b16963e9761c9b8e95f/users/496be8ef31484b979cd5125f3e0c5c93/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:19.218104 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755eddc-fdf1-44aa-b432-62a7662e17ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc343c4856bf4b16963e9761c9b8e95f, user_id=496be8ef31484b979cd5125f3e0c5c93, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:19.220753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755eddc-fdf1-44aa-b432-62a7662e17ee admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:19.231347 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1394/2777] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:17:19 2022] PUT /identity/v3/projects/fc343c4856bf4b16963e9761c9b8e95f/users/496be8ef31484b979cd5125f3e0c5c93/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:17:25.125348 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c42d-4b30-430d-8099-e15f993e2ee0 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:25.126804 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c42d-4b30-430d-8099-e15f993e2ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:25.127297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c42d-4b30-430d-8099-e15f993e2ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:25.160852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-0a31c42d-4b30-430d-8099-e15f993e2ee0 None None] MFA Rules not processed for user `496be8ef31484b979cd5125f3e0c5c93`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:17:25.162458 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0a31c42d-4b30-430d-8099-e15f993e2ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:25.238944 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1384/2778] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:17:25.254478 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755eddc-fdf1-44aa-b432-62a7662e17ee admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:25.256139 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f755eddc-fdf1-44aa-b432-62a7662e17ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:25.329638 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755eddc-fdf1-44aa-b432-62a7662e17ee admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:25.335742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f873-9dfc-4d3d-8a0f-3d94b97a5137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:25.336582 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f873-9dfc-4d3d-8a0f-3d94b97a5137 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:25.336875 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f873-9dfc-4d3d-8a0f-3d94b97a5137 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:25.337161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f873-9dfc-4d3d-8a0f-3d94b97a5137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:25.392401 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126f873-9dfc-4d3d-8a0f-3d94b97a5137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:25.394029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126f873-9dfc-4d3d-8a0f-3d94b97a5137 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:25.403651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1395/2779] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:17:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:17:35.047003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31c42d-4b30-430d-8099-e15f993e2ee0 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:35.048421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-0a31c42d-4b30-430d-8099-e15f993e2ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:35.133048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31c42d-4b30-430d-8099-e15f993e2ee0 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:35.139230 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcb4cb-fbd9-404b-84e3-2f4959e65b4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:35.139909 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcb4cb-fbd9-404b-84e3-2f4959e65b4e service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:35.140197 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcb4cb-fbd9-404b-84e3-2f4959e65b4e service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:35.140504 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcb4cb-fbd9-404b-84e3-2f4959e65b4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:35.142359 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2cbcb4cb-fbd9-404b-84e3-2f4959e65b4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:35.154933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcb4cb-fbd9-404b-84e3-2f4959e65b4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:35.156509 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcb4cb-fbd9-404b-84e3-2f4959e65b4e service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:35.166883 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1385/2780] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:17:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:17:44.730865 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f6d18-947c-40c8-a4af-35d58e47782e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:44.731360 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f6d18-947c-40c8-a4af-35d58e47782e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:44.731495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f6d18-947c-40c8-a4af-35d58e47782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:44.748862 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-599f6d18-947c-40c8-a4af-35d58e47782e None None] MFA Rules not processed for user `ce3a8645c67e438f8f4e6aa933daeb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:17:44.750043 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-599f6d18-947c-40c8-a4af-35d58e47782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:44.756863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1396/2781] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:17:44.792764 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcb4cb-fbd9-404b-84e3-2f4959e65b4e service placement] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:44.794205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2cbcb4cb-fbd9-404b-84e3-2f4959e65b4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:44.848527 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcb4cb-fbd9-404b-84e3-2f4959e65b4e service placement] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:44.852123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e7c87-d42c-425b-b61f-cb6485ea8c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:44.852768 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e7c87-d42c-425b-b61f-cb6485ea8c37 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:44.853054 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e7c87-d42c-425b-b61f-cb6485ea8c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:44.853373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e7c87-d42c-425b-b61f-cb6485ea8c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:44.855259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a18e7c87-d42c-425b-b61f-cb6485ea8c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:44.868524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e7c87-d42c-425b-b61f-cb6485ea8c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:44.870104 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e7c87-d42c-425b-b61f-cb6485ea8c37 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:44.880843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1386/2782] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:17:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:17:45.163990 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f6d18-947c-40c8-a4af-35d58e47782e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:45.165406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-599f6d18-947c-40c8-a4af-35d58e47782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:45.233574 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f6d18-947c-40c8-a4af-35d58e47782e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:45.237358 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcd65e-f770-432e-99c2-745ea1a56179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:45.238020 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcd65e-f770-432e-99c2-745ea1a56179 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:45.238307 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcd65e-f770-432e-99c2-745ea1a56179 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:45.238587 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcd65e-f770-432e-99c2-745ea1a56179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:45.240811 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-83fcd65e-f770-432e-99c2-745ea1a56179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:45.252723 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcd65e-f770-432e-99c2-745ea1a56179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:45.254379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcd65e-f770-432e-99c2-745ea1a56179 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:45.263048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1397/2783] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:17:45.910444 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e7c87-d42c-425b-b61f-cb6485ea8c37 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:45.912001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-a18e7c87-d42c-425b-b61f-cb6485ea8c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:45.927134 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e7c87-d42c-425b-b61f-cb6485ea8c37 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:45.932428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01acd7c-d7f4-43da-9fec-3938002f896e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:45.933867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01acd7c-d7f4-43da-9fec-3938002f896e service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:45.934513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01acd7c-d7f4-43da-9fec-3938002f896e service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:45.934877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01acd7c-d7f4-43da-9fec-3938002f896e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:45.936703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e01acd7c-d7f4-43da-9fec-3938002f896e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:45.951012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01acd7c-d7f4-43da-9fec-3938002f896e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:45.952837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01acd7c-d7f4-43da-9fec-3938002f896e service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:45.964273 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1387/2784] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:17:49.801524 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcd65e-f770-432e-99c2-745ea1a56179 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:49.817812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcd65e-f770-432e-99c2-745ea1a56179 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:49.825160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3eeb9-af82-4f96-83e6-9d867b77cb03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:49.827067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3eeb9-af82-4f96-83e6-9d867b77cb03 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:49.827435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3eeb9-af82-4f96-83e6-9d867b77cb03 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:49.827851 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3eeb9-af82-4f96-83e6-9d867b77cb03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:49.830003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-04f3eeb9-af82-4f96-83e6-9d867b77cb03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:49.844475 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3eeb9-af82-4f96-83e6-9d867b77cb03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:49.846211 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3eeb9-af82-4f96-83e6-9d867b77cb03 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:49.858165 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1398/2785] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:17:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:17:59.929752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01acd7c-d7f4-43da-9fec-3938002f896e service placement] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:17:59.942002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01acd7c-d7f4-43da-9fec-3938002f896e service placement] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:17:59.947446 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca91c8-fe96-4548-831e-4eb12e785a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:17:59.948203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca91c8-fe96-4548-831e-4eb12e785a48 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:17:59.948495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca91c8-fe96-4548-831e-4eb12e785a48 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:17:59.948775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca91c8-fe96-4548-831e-4eb12e785a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:17:59.950519 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-26ca91c8-fe96-4548-831e-4eb12e785a48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:17:59.962786 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca91c8-fe96-4548-831e-4eb12e785a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:17:59.964344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca91c8-fe96-4548-831e-4eb12e785a48 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:17:59.975480 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1388/2786] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:17:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:18:02.713386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3eeb9-af82-4f96-83e6-9d867b77cb03 service nova] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:18:02.723209 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3eeb9-af82-4f96-83e6-9d867b77cb03 service nova] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:18:02.726775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca388a-5bb5-4a92-bb4f-e4c52ff43933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:18:02.727590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca388a-5bb5-4a92-bb4f-e4c52ff43933 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:18:02.727700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca388a-5bb5-4a92-bb4f-e4c52ff43933 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:18:02.727971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca388a-5bb5-4a92-bb4f-e4c52ff43933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:18:02.737128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca388a-5bb5-4a92-bb4f-e4c52ff43933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:18:02.738646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca388a-5bb5-4a92-bb4f-e4c52ff43933 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:18:02.748229 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1399/2787] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:18:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:19:32.052741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca91c8-fe96-4548-831e-4eb12e785a48 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:19:32.052741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca91c8-fe96-4548-831e-4eb12e785a48 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:19:32.052741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f1560-94e0-4d35-89f1-2badbecd3cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:19:32.052741 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f1560-94e0-4d35-89f1-2badbecd3cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:19:32.053583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f1560-94e0-4d35-89f1-2badbecd3cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:19:32.053583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f1560-94e0-4d35-89f1-2badbecd3cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:19:32.053583 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-3f8f1560-94e0-4d35-89f1-2badbecd3cc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:19:32.072273 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f1560-94e0-4d35-89f1-2badbecd3cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:19:32.073738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f1560-94e0-4d35-89f1-2badbecd3cc8 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:19:32.091978 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1389/2788] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:19:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:19:43.783169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca388a-5bb5-4a92-bb4f-e4c52ff43933 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:19:43.791820 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca388a-5bb5-4a92-bb4f-e4c52ff43933 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:19:43.795472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959d915-a4ce-4bc8-a5ac-05495f510b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:19:43.796118 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d915-a4ce-4bc8-a5ac-05495f510b83 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:19:43.796406 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d915-a4ce-4bc8-a5ac-05495f510b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:19:43.796686 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d915-a4ce-4bc8-a5ac-05495f510b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:19:43.798489 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9959d915-a4ce-4bc8-a5ac-05495f510b83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:19:43.808793 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959d915-a4ce-4bc8-a5ac-05495f510b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:19:43.810240 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959d915-a4ce-4bc8-a5ac-05495f510b83 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:19:43.818691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1400/2789] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:19:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:20:04.331882 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053be6f-e834-444e-ba6e-4edf22ff28aa None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:20:04.332354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053be6f-e834-444e-ba6e-4edf22ff28aa None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:20:04.332437 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053be6f-e834-444e-ba6e-4edf22ff28aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:20:04.351787 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-2053be6f-e834-444e-ba6e-4edf22ff28aa None None] MFA Rules not processed for user `ce3a8645c67e438f8f4e6aa933daeb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:20:04.353001 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2053be6f-e834-444e-ba6e-4edf22ff28aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:20:04.360004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1390/2790] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:21:41.118458 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959d915-a4ce-4bc8-a5ac-05495f510b83 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:41.127610 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959d915-a4ce-4bc8-a5ac-05495f510b83 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:41.131248 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85647d1d-126a-4148-aa9f-98c288c18a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:41.131899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647d1d-126a-4148-aa9f-98c288c18a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:41.132185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647d1d-126a-4148-aa9f-98c288c18a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:41.132463 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647d1d-126a-4148-aa9f-98c288c18a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:41.134277 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-85647d1d-126a-4148-aa9f-98c288c18a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:21:41.227790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85647d1d-126a-4148-aa9f-98c288c18a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:41.229213 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85647d1d-126a-4148-aa9f-98c288c18a05 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:41.248532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1401/2791] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:21:45.152798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053be6f-e834-444e-ba6e-4edf22ff28aa None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:45.152798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-2053be6f-e834-444e-ba6e-4edf22ff28aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:21:45.171706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053be6f-e834-444e-ba6e-4edf22ff28aa None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:45.176327 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:45.177212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:45.177577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:45.177852 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] PATH_INFO: `/v3/users/e3fa08cd466c419e80198a5b44b719f9` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:45.179106 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3fa08cd466c419e80198a5b44b719f9)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:45.181030 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:45.359914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3fa08cd466c419e80198a5b44b719f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:21:45.373137 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3fa08cd466c419e80198a5b44b719f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:21:45.373976 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3fa08cd466c419e80198a5b44b719f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:21:45.448949 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3fa08cd466c419e80198a5b44b719f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:21:45.457519 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-996b7e89-a141-4c16-af61-e4603f7d5e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3fa08cd466c419e80198a5b44b719f9'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:21:45.467769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1391/2792] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:21:45 2022] DELETE /identity/v3/users/e3fa08cd466c419e80198a5b44b719f9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:21:45.719666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85647d1d-126a-4148-aa9f-98c288c18a05 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:45.732441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85647d1d-126a-4148-aa9f-98c288c18a05 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:45.796174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:45.797045 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:45.797361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:45.797646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] PATH_INFO: `/v3/projects/726b268af80347bbbf58e80cef5c61bc` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:45.798842 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726b268af80347bbbf58e80cef5c61bc)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:45.800751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:45.947884 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726b268af80347bbbf58e80cef5c61bc', 'request_id': 'req-f3ff17db-34da-401a-91e5-9093bcff1382'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:21:45.954010 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726b268af80347bbbf58e80cef5c61bc', 'request_id': 'req-f3ff17db-34da-401a-91e5-9093bcff1382'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:21:46.048430 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726b268af80347bbbf58e80cef5c61bc', 'request_id': 'req-f3ff17db-34da-401a-91e5-9093bcff1382'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:21:46.061665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] The token cache is being invalidate because project 726b268af80347bbbf58e80cef5c61bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:21:46.062227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:21:46.062955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-f3ff17db-34da-401a-91e5-9093bcff1382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:21:46.064645 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1402/2793] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:21:45 2022] DELETE /identity/v3/projects/726b268af80347bbbf58e80cef5c61bc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:21:46.070676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b4f5a-d8d0-409d-b605-7a2e68179403 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:46.071204 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b4f5a-d8d0-409d-b605-7a2e68179403 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:46.071725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b4f5a-d8d0-409d-b605-7a2e68179403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:46.101526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-042b4f5a-d8d0-409d-b605-7a2e68179403 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:21:46.103685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-042b4f5a-d8d0-409d-b605-7a2e68179403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:21:46.198223 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1392/2794] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:21:46.210540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea8d7-c3d4-4bb7-9de5-7734049012b9 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:46.210842 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea8d7-c3d4-4bb7-9de5-7734049012b9 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:46.211129 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea8d7-c3d4-4bb7-9de5-7734049012b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:46.231666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-f73ea8d7-c3d4-4bb7-9de5-7734049012b9 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:21:46.232906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-f73ea8d7-c3d4-4bb7-9de5-7734049012b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:21:46.244154 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1403/2795] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:21:46.249661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b4f5a-d8d0-409d-b605-7a2e68179403 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:46.261164 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b4f5a-d8d0-409d-b605-7a2e68179403 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:46.266706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d1404-6c77-49ee-aad2-337eb443305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:46.267381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d1404-6c77-49ee-aad2-337eb443305f admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:46.267667 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d1404-6c77-49ee-aad2-337eb443305f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:46.267948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d1404-6c77-49ee-aad2-337eb443305f admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:46.268686 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d1404-6c77-49ee-aad2-337eb443305f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:21:46.268997 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d1404-6c77-49ee-aad2-337eb443305f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:46.270726 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d1404-6c77-49ee-aad2-337eb443305f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:46.283925 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1393/2796] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:21:46.289332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ea8d7-c3d4-4bb7-9de5-7734049012b9 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:46.304982 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ea8d7-c3d4-4bb7-9de5-7734049012b9 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:46.311797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c6c1e-80ad-43e2-abb5-1f8614fef5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:46.312857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c6c1e-80ad-43e2-abb5-1f8614fef5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:46.313387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c6c1e-80ad-43e2-abb5-1f8614fef5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:46.313861 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c6c1e-80ad-43e2-abb5-1f8614fef5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:46.315203 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c6c1e-80ad-43e2-abb5-1f8614fef5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:46.318824 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c6c1e-80ad-43e2-abb5-1f8614fef5f8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:46.417353 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1404/2797] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:21:46 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:21:46.422613 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d1404-6c77-49ee-aad2-337eb443305f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:46.433015 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d1404-6c77-49ee-aad2-337eb443305f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:46.495977 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f4afd-b00b-45ad-b9d6-095857c252a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:46.496933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f4afd-b00b-45ad-b9d6-095857c252a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:46.497371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f4afd-b00b-45ad-b9d6-095857c252a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:46.497780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f4afd-b00b-45ad-b9d6-095857c252a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:46.499024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f4afd-b00b-45ad-b9d6-095857c252a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:46.502369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f4afd-b00b-45ad-b9d6-095857c252a4 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:46.602709 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1394/2798] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:21:46 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:21:46.607688 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c6c1e-80ad-43e2-abb5-1f8614fef5f8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:46.621220 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c6c1e-80ad-43e2-abb5-1f8614fef5f8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:46.627501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cabba-a0b5-4b58-a616-3402c8755ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:46.628296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cabba-a0b5-4b58-a616-3402c8755ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:46.628813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cabba-a0b5-4b58-a616-3402c8755ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:46.629374 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cabba-a0b5-4b58-a616-3402c8755ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:46.630813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cabba-a0b5-4b58-a616-3402c8755ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:46.633849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cabba-a0b5-4b58-a616-3402c8755ff3 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:46.651092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1405/2799] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:21:46.656858 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f4afd-b00b-45ad-b9d6-095857c252a4 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:46.671527 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f4afd-b00b-45ad-b9d6-095857c252a4 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:46.678769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd1e30-f332-4c02-9531-d89fb820f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:46.678769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd1e30-f332-4c02-9531-d89fb820f0cb admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:46.678769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd1e30-f332-4c02-9531-d89fb820f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:46.678769 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd1e30-f332-4c02-9531-d89fb820f0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:46.679357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd1e30-f332-4c02-9531-d89fb820f0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:46.681240 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd1e30-f332-4c02-9531-d89fb820f0cb admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:46.701585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1395/2800] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:21:46.706848 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cabba-a0b5-4b58-a616-3402c8755ff3 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:46.718674 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cabba-a0b5-4b58-a616-3402c8755ff3 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:46.724356 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6d783-6741-4e7b-8944-c8f8442bf40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:46.725378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d783-6741-4e7b-8944-c8f8442bf40f admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:46.725669 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d783-6741-4e7b-8944-c8f8442bf40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:46.725962 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6d783-6741-4e7b-8944-c8f8442bf40f admin admin] PATH_INFO: `/v3/projects/30b0505a95a54eeebd130a0e8446f5d4/users/effef27a73bc476082aab807beec06db/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:46.742171 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6d783-6741-4e7b-8944-c8f8442bf40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b0505a95a54eeebd130a0e8446f5d4, user_id=effef27a73bc476082aab807beec06db, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:46.745467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6d783-6741-4e7b-8944-c8f8442bf40f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:46.836774 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1406/2801] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:21:46 2022] PUT /identity/v3/projects/30b0505a95a54eeebd130a0e8446f5d4/users/effef27a73bc476082aab807beec06db/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:21:46.849345 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfefcb-9190-429b-86bc-b9c470f214c6 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:46.849649 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfefcb-9190-429b-86bc-b9c470f214c6 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:46.849935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfefcb-9190-429b-86bc-b9c470f214c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:46.889468 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-45bfefcb-9190-429b-86bc-b9c470f214c6 None None] MFA Rules not processed for user `effef27a73bc476082aab807beec06db`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:21:46.890740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-45bfefcb-9190-429b-86bc-b9c470f214c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:21:46.970908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1396/2802] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:21:46.975854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6d783-6741-4e7b-8944-c8f8442bf40f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:47.051985 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6d783-6741-4e7b-8944-c8f8442bf40f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:47.056772 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b252ee-94df-424b-996a-4d3fae070dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:47.057465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b252ee-94df-424b-996a-4d3fae070dee admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:47.057758 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b252ee-94df-424b-996a-4d3fae070dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:47.058038 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b252ee-94df-424b-996a-4d3fae070dee admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:47.058750 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b252ee-94df-424b-996a-4d3fae070dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:47.061685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b252ee-94df-424b-996a-4d3fae070dee admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:47.154243 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1407/2803] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:21:46 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:21:47.158392 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfefcb-9190-429b-86bc-b9c470f214c6 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:47.174643 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfefcb-9190-429b-86bc-b9c470f214c6 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:47.245754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d171be3-872b-4479-a9c0-8487047774d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:47.247271 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d171be3-872b-4479-a9c0-8487047774d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:47.247565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d171be3-872b-4479-a9c0-8487047774d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:47.247843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d171be3-872b-4479-a9c0-8487047774d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:47.248550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d171be3-872b-4479-a9c0-8487047774d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:47.250500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d171be3-872b-4479-a9c0-8487047774d6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:47.335066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1397/2804] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:21:47 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:21:47.339287 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b252ee-94df-424b-996a-4d3fae070dee admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:47.350528 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b252ee-94df-424b-996a-4d3fae070dee admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:47.356306 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f2fcb-e900-42aa-b879-f98fdd5241c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:47.359550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f2fcb-e900-42aa-b879-f98fdd5241c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:47.359550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f2fcb-e900-42aa-b879-f98fdd5241c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:47.359550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f2fcb-e900-42aa-b879-f98fdd5241c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:47.359550 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f2fcb-e900-42aa-b879-f98fdd5241c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:47.360087 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f2fcb-e900-42aa-b879-f98fdd5241c9 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:47.371296 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1408/2805] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:21:47.376464 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d171be3-872b-4479-a9c0-8487047774d6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:47.386586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d171be3-872b-4479-a9c0-8487047774d6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:47.391829 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d78147-f6d2-4495-a07d-1f387f52e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:47.392708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d78147-f6d2-4495-a07d-1f387f52e773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:47.392985 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d78147-f6d2-4495-a07d-1f387f52e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:47.393259 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d78147-f6d2-4495-a07d-1f387f52e773 admin admin] PATH_INFO: `/v3/projects/14ac5c7fcc8f4f6db980f345e4e25c1b/users/36d147a2943e4bc28c8f750f5b16ca67/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:47.409039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d78147-f6d2-4495-a07d-1f387f52e773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ac5c7fcc8f4f6db980f345e4e25c1b, user_id=36d147a2943e4bc28c8f750f5b16ca67, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:47.411642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d78147-f6d2-4495-a07d-1f387f52e773 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:47.510264 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1398/2806] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:21:47 2022] PUT /identity/v3/projects/14ac5c7fcc8f4f6db980f345e4e25c1b/users/36d147a2943e4bc28c8f750f5b16ca67/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:21:47.514662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f2fcb-e900-42aa-b879-f98fdd5241c9 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:47.524857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f2fcb-e900-42aa-b879-f98fdd5241c9 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:47.584906 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008d9a7-c62f-4908-bdc8-4a6343927ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:47.585650 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d9a7-c62f-4908-bdc8-4a6343927ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:47.585945 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d9a7-c62f-4908-bdc8-4a6343927ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:47.586227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d9a7-c62f-4908-bdc8-4a6343927ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:47.586969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008d9a7-c62f-4908-bdc8-4a6343927ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:47.589153 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008d9a7-c62f-4908-bdc8-4a6343927ee3 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:47.602568 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1409/2807] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:21:47.607311 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d78147-f6d2-4495-a07d-1f387f52e773 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:47.617990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d78147-f6d2-4495-a07d-1f387f52e773 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:47.624062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e87626-088d-4f64-bc71-c99abece3897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:47.625058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e87626-088d-4f64-bc71-c99abece3897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:47.625431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e87626-088d-4f64-bc71-c99abece3897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:47.625774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e87626-088d-4f64-bc71-c99abece3897 admin admin] PATH_INFO: `/v3/projects/14ac5c7fcc8f4f6db980f345e4e25c1b/users/36d147a2943e4bc28c8f750f5b16ca67/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:47.628004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e87626-088d-4f64-bc71-c99abece3897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ac5c7fcc8f4f6db980f345e4e25c1b, user_id=36d147a2943e4bc28c8f750f5b16ca67, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:47.630724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e87626-088d-4f64-bc71-c99abece3897 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:47.642988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1399/2808] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:21:47 2022] PUT /identity/v3/projects/14ac5c7fcc8f4f6db980f345e4e25c1b/users/36d147a2943e4bc28c8f750f5b16ca67/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:21:47.655924 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216c3e3-ddaa-442f-b7a3-03c154217545 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:47.656266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216c3e3-ddaa-442f-b7a3-03c154217545 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:47.656549 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216c3e3-ddaa-442f-b7a3-03c154217545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:47.687621 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-9216c3e3-ddaa-442f-b7a3-03c154217545 None None] MFA Rules not processed for user `36d147a2943e4bc28c8f750f5b16ca67`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:21:47.689462 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9216c3e3-ddaa-442f-b7a3-03c154217545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:21:47.765532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1410/2809] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:21:47.776750 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e87626-088d-4f64-bc71-c99abece3897 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:47.779917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-d3e87626-088d-4f64-bc71-c99abece3897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:21:47.862718 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e87626-088d-4f64-bc71-c99abece3897 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:47.866774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6d1c7-3efe-4310-b128-4adc58581072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:47.867441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d1c7-3efe-4310-b128-4adc58581072 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:47.867730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d1c7-3efe-4310-b128-4adc58581072 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:47.868012 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d1c7-3efe-4310-b128-4adc58581072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:47.936645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6d1c7-3efe-4310-b128-4adc58581072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:47.938216 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6d1c7-3efe-4310-b128-4adc58581072 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:47.947982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1400/2810] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:21:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:21:54.162987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216c3e3-ddaa-442f-b7a3-03c154217545 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:21:54.164388 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9216c3e3-ddaa-442f-b7a3-03c154217545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:21:54.176590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216c3e3-ddaa-442f-b7a3-03c154217545 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:21:54.180250 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c019cd9-ebfe-441f-af33-31adc8959200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:21:54.184280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c019cd9-ebfe-441f-af33-31adc8959200 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:21:54.184280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c019cd9-ebfe-441f-af33-31adc8959200 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:21:54.184280 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c019cd9-ebfe-441f-af33-31adc8959200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:21:54.190886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c019cd9-ebfe-441f-af33-31adc8959200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:21:54.192301 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c019cd9-ebfe-441f-af33-31adc8959200 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:21:54.202339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1411/2811] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:21:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:15.241982 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220728c-0185-4f07-8896-c18cbc8cc2e5 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:15.242550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220728c-0185-4f07-8896-c18cbc8cc2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:15.242550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220728c-0185-4f07-8896-c18cbc8cc2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:15.260195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-8220728c-0185-4f07-8896-c18cbc8cc2e5 None None] MFA Rules not processed for user `ce3a8645c67e438f8f4e6aa933daeb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:15.261443 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-8220728c-0185-4f07-8896-c18cbc8cc2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:15.316723 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1401/2812] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:23.494823 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c019cd9-ebfe-441f-af33-31adc8959200 service cinder] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:23.556253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c019cd9-ebfe-441f-af33-31adc8959200 service cinder] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:23.560766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:23.561665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:23.561957 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:23.562242 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] PATH_INFO: `/v3/users/effef27a73bc476082aab807beec06db` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:23.563441 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=effef27a73bc476082aab807beec06db)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:23.565605 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:23.764202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'effef27a73bc476082aab807beec06db'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:23.764858 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'effef27a73bc476082aab807beec06db'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:23.765493 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'effef27a73bc476082aab807beec06db'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:23.777771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'effef27a73bc476082aab807beec06db'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:23.784891 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'effef27a73bc476082aab807beec06db'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:23.859917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1412/2813] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:22:23 2022] DELETE /identity/v3/users/effef27a73bc476082aab807beec06db => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:23.864533 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd28c37-5736-468f-9353-40ec80b8166a None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:23.864936 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd28c37-5736-468f-9353-40ec80b8166a None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:23.865082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd28c37-5736-468f-9353-40ec80b8166a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:23.883305 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-7dd28c37-5736-468f-9353-40ec80b8166a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:23.884490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7dd28c37-5736-468f-9353-40ec80b8166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:23.945739 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1402/2814] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:23.955504 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:23.956975 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:24.015149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57da2-dc45-4d88-9c1c-60cb50cc8e3c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:24.018832 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71a227-a3c8-400f-90ac-ba5843df31c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:24.019485 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71a227-a3c8-400f-90ac-ba5843df31c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:24.019766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71a227-a3c8-400f-90ac-ba5843df31c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:24.020044 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71a227-a3c8-400f-90ac-ba5843df31c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:24.029918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71a227-a3c8-400f-90ac-ba5843df31c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:24.031341 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71a227-a3c8-400f-90ac-ba5843df31c3 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:24.041352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1413/2815] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:24.472760 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd28c37-5736-468f-9353-40ec80b8166a None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:24.474212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-7dd28c37-5736-468f-9353-40ec80b8166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:24.487762 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd28c37-5736-468f-9353-40ec80b8166a None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:24.494725 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:24.495812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:24.496056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:24.496335 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] PATH_INFO: `/v3/projects/30b0505a95a54eeebd130a0e8446f5d4` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:24.497618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b0505a95a54eeebd130a0e8446f5d4)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:24.499512 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:24.596768 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b0505a95a54eeebd130a0e8446f5d4', 'request_id': 'req-c5998d8c-6061-4459-8a95-c05d5b374c42'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:24.602671 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b0505a95a54eeebd130a0e8446f5d4', 'request_id': 'req-c5998d8c-6061-4459-8a95-c05d5b374c42'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:24.693834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b0505a95a54eeebd130a0e8446f5d4', 'request_id': 'req-c5998d8c-6061-4459-8a95-c05d5b374c42'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:24.706574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] The token cache is being invalidate because project 30b0505a95a54eeebd130a0e8446f5d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:22:24.706846 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:24.707487 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:24.709133 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1403/2816] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:22:24 2022] DELETE /identity/v3/projects/30b0505a95a54eeebd130a0e8446f5d4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:24.713631 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71a227-a3c8-400f-90ac-ba5843df31c3 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:24.724282 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71a227-a3c8-400f-90ac-ba5843df31c3 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:24.783466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:24.784337 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:24.784623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:24.784899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] PATH_INFO: `/v3/users/36d147a2943e4bc28c8f750f5b16ca67` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:24.786108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d147a2943e4bc28c8f750f5b16ca67)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:24.788152 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:24.964392 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d147a2943e4bc28c8f750f5b16ca67'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:24.964981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d147a2943e4bc28c8f750f5b16ca67'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:24.965608 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d147a2943e4bc28c8f750f5b16ca67'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:24.977960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d147a2943e4bc28c8f750f5b16ca67'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:24.984664 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d147a2943e4bc28c8f750f5b16ca67'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:25.047784 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1414/2817] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:22:24 2022] DELETE /identity/v3/users/36d147a2943e4bc28c8f750f5b16ca67 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:25.416011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:25.417626 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:25.431722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5998d8c-6061-4459-8a95-c05d5b374c42 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:25.489355 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:25.490136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:25.490420 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:25.490698 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] PATH_INFO: `/v3/projects/14ac5c7fcc8f4f6db980f345e4e25c1b` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:25.491879 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ac5c7fcc8f4f6db980f345e4e25c1b)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:25.493838 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:25.591205 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ac5c7fcc8f4f6db980f345e4e25c1b', 'request_id': 'req-7d9030f3-a375-442d-9f86-2cfce71ea31c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:25.596529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ac5c7fcc8f4f6db980f345e4e25c1b', 'request_id': 'req-7d9030f3-a375-442d-9f86-2cfce71ea31c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:25.638310 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:25.639746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:25.677434 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ac5c7fcc8f4f6db980f345e4e25c1b', 'request_id': 'req-7d9030f3-a375-442d-9f86-2cfce71ea31c'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:25.689169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] The token cache is being invalidate because project 14ac5c7fcc8f4f6db980f345e4e25c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:22:25.689494 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:25.690227 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-7d9030f3-a375-442d-9f86-2cfce71ea31c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:25.691796 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1404/2818] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:22:25 2022] DELETE /identity/v3/projects/14ac5c7fcc8f4f6db980f345e4e25c1b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:25.696999 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5a877-c79a-463a-9c7d-11d20abfb7a3 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:25.697297 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5a877-c79a-463a-9c7d-11d20abfb7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:25.697589 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5a877-c79a-463a-9c7d-11d20abfb7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:25.717617 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e5d5a877-c79a-463a-9c7d-11d20abfb7a3 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:25.718843 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e5d5a877-c79a-463a-9c7d-11d20abfb7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:25.723109 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c8319-423b-4d95-8aab-d05135e9ddcf admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:25.787326 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1405/2819] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:22:25.788178 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311e21-9e24-4b16-ae18-c9097d47c1e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:25.788838 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311e21-9e24-4b16-ae18-c9097d47c1e2 service nova] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:25.789137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311e21-9e24-4b16-ae18-c9097d47c1e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:25.789612 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311e21-9e24-4b16-ae18-c9097d47c1e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:25.791496 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-be311e21-9e24-4b16-ae18-c9097d47c1e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:25.794814 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641019b-8a96-4a55-96f2-f58cb1b1be87 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:25.795103 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641019b-8a96-4a55-96f2-f58cb1b1be87 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:25.795441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641019b-8a96-4a55-96f2-f58cb1b1be87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:25.812775 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-6641019b-8a96-4a55-96f2-f58cb1b1be87 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:25.814009 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6641019b-8a96-4a55-96f2-f58cb1b1be87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:25.823324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1406/2820] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:22:25.827593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641019b-8a96-4a55-96f2-f58cb1b1be87 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:25.837087 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641019b-8a96-4a55-96f2-f58cb1b1be87 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:25.841915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0451ba-36cf-4679-bed6-619cef49e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:25.842566 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0451ba-36cf-4679-bed6-619cef49e1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:25.842851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0451ba-36cf-4679-bed6-619cef49e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:25.843131 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0451ba-36cf-4679-bed6-619cef49e1f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:25.843866 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0451ba-36cf-4679-bed6-619cef49e1f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:22:25.844179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0451ba-36cf-4679-bed6-619cef49e1f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:25.845805 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0451ba-36cf-4679-bed6-619cef49e1f2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:25.851390 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311e21-9e24-4b16-ae18-c9097d47c1e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:25.854289 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be311e21-9e24-4b16-ae18-c9097d47c1e2 service nova] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:25.858967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1407/2821] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 21:22:25.863276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0451ba-36cf-4679-bed6-619cef49e1f2 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:25.867150 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1415/2822] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:22:25.874410 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0451ba-36cf-4679-bed6-619cef49e1f2 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:25.879347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4de92-ccba-4329-bbbe-b6cfa89a19d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:25.880004 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4de92-ccba-4329-bbbe-b6cfa89a19d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:25.880289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4de92-ccba-4329-bbbe-b6cfa89a19d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:25.880553 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4de92-ccba-4329-bbbe-b6cfa89a19d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:25.881513 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4de92-ccba-4329-bbbe-b6cfa89a19d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:25.883276 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4de92-ccba-4329-bbbe-b6cfa89a19d8 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:26.025476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1408/2823] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:22:25 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:26.026713 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311e21-9e24-4b16-ae18-c9097d47c1e2 service nova] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:26.038833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311e21-9e24-4b16-ae18-c9097d47c1e2 service nova] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:26.100169 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4140f-409c-4c08-82d9-ee2eb15832ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:26.101147 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4140f-409c-4c08-82d9-ee2eb15832ee admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:26.101651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4140f-409c-4c08-82d9-ee2eb15832ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:26.102494 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4140f-409c-4c08-82d9-ee2eb15832ee admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:26.103247 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4140f-409c-4c08-82d9-ee2eb15832ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:26.105172 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4140f-409c-4c08-82d9-ee2eb15832ee admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:26.235344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1416/2824] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:22:26 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:26.239694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4de92-ccba-4329-bbbe-b6cfa89a19d8 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:26.250514 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4de92-ccba-4329-bbbe-b6cfa89a19d8 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:26.255136 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad054a1a-0442-4345-91ee-ad6e5400a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:26.255821 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad054a1a-0442-4345-91ee-ad6e5400a3ab admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:26.256108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad054a1a-0442-4345-91ee-ad6e5400a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:26.256411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad054a1a-0442-4345-91ee-ad6e5400a3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:26.257154 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad054a1a-0442-4345-91ee-ad6e5400a3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:26.258861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad054a1a-0442-4345-91ee-ad6e5400a3ab admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:26.272282 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1409/2825] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:26.273398 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4140f-409c-4c08-82d9-ee2eb15832ee admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:26.284481 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4140f-409c-4c08-82d9-ee2eb15832ee admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:26.290200 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490000e-ca7e-4227-bb3c-69970eaa3e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:26.290927 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490000e-ca7e-4227-bb3c-69970eaa3e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:26.291220 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490000e-ca7e-4227-bb3c-69970eaa3e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:26.291501 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490000e-ca7e-4227-bb3c-69970eaa3e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:26.292249 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490000e-ca7e-4227-bb3c-69970eaa3e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:26.293921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490000e-ca7e-4227-bb3c-69970eaa3e88 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:26.304630 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1417/2826] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:26.309010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad054a1a-0442-4345-91ee-ad6e5400a3ab admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:26.321872 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad054a1a-0442-4345-91ee-ad6e5400a3ab admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:26.326472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22caf05-0dc7-4be1-aedf-5debae85bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:26.327347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22caf05-0dc7-4be1-aedf-5debae85bdaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:26.327630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22caf05-0dc7-4be1-aedf-5debae85bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:26.327933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22caf05-0dc7-4be1-aedf-5debae85bdaa admin admin] PATH_INFO: `/v3/projects/d600016087ca40b89edb0d75491dd0ba/users/e40d86238b7f4c65a324c52684f64ef0/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:26.342531 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22caf05-0dc7-4be1-aedf-5debae85bdaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d600016087ca40b89edb0d75491dd0ba, user_id=e40d86238b7f4c65a324c52684f64ef0, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:26.345261 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22caf05-0dc7-4be1-aedf-5debae85bdaa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:26.437294 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1410/2827] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:26 2022] PUT /identity/v3/projects/d600016087ca40b89edb0d75491dd0ba/users/e40d86238b7f4c65a324c52684f64ef0/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:26.499815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156e61-2227-431e-afd3-bb914e5eca66 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:26.500127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156e61-2227-431e-afd3-bb914e5eca66 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:26.500415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71156e61-2227-431e-afd3-bb914e5eca66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:26.526821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-71156e61-2227-431e-afd3-bb914e5eca66 None None] MFA Rules not processed for user `e40d86238b7f4c65a324c52684f64ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:26.528021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-71156e61-2227-431e-afd3-bb914e5eca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:26.590515 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1418/2828] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:26.594992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22caf05-0dc7-4be1-aedf-5debae85bdaa admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:26.656557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22caf05-0dc7-4be1-aedf-5debae85bdaa admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:26.661212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6aed2-db11-48df-a7d4-cef50a884d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:26.661908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6aed2-db11-48df-a7d4-cef50a884d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:26.662195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6aed2-db11-48df-a7d4-cef50a884d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:26.662477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6aed2-db11-48df-a7d4-cef50a884d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:26.663190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6aed2-db11-48df-a7d4-cef50a884d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:26.665117 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6aed2-db11-48df-a7d4-cef50a884d88 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:26.750881 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1411/2829] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:22:26 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:26.754932 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71156e61-2227-431e-afd3-bb914e5eca66 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:26.766467 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71156e61-2227-431e-afd3-bb914e5eca66 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:26.824718 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b22d7-58be-48fd-91f5-faafd605a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:26.825431 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b22d7-58be-48fd-91f5-faafd605a856 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:26.825754 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b22d7-58be-48fd-91f5-faafd605a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:26.826040 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b22d7-58be-48fd-91f5-faafd605a856 admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:26.826751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b22d7-58be-48fd-91f5-faafd605a856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:26.828751 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b22d7-58be-48fd-91f5-faafd605a856 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:26.954988 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1419/2830] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:22:26 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:26.958989 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6aed2-db11-48df-a7d4-cef50a884d88 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:26.969886 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6aed2-db11-48df-a7d4-cef50a884d88 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:26.974614 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361d8bc-08e0-4c1c-822a-37be8281f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:26.975278 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361d8bc-08e0-4c1c-822a-37be8281f9af admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:26.975571 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361d8bc-08e0-4c1c-822a-37be8281f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:26.975856 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361d8bc-08e0-4c1c-822a-37be8281f9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:26.976596 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361d8bc-08e0-4c1c-822a-37be8281f9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:26.978915 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361d8bc-08e0-4c1c-822a-37be8281f9af admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:26.989539 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1412/2831] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:26.994323 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b22d7-58be-48fd-91f5-faafd605a856 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:27.004078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b22d7-58be-48fd-91f5-faafd605a856 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:27.009245 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9b398-114b-46e9-86e0-2b28318fa90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:27.010162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9b398-114b-46e9-86e0-2b28318fa90f admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:27.010446 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9b398-114b-46e9-86e0-2b28318fa90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:27.010722 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9b398-114b-46e9-86e0-2b28318fa90f admin admin] PATH_INFO: `/v3/projects/197f43fa73664f3ba1f3dec8f1496634/users/cb9119fd30bb42d89d8996077f4720df/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:27.026614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9b398-114b-46e9-86e0-2b28318fa90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=197f43fa73664f3ba1f3dec8f1496634, user_id=cb9119fd30bb42d89d8996077f4720df, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:27.029836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9b398-114b-46e9-86e0-2b28318fa90f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:27.105687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1420/2832] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:26 2022] PUT /identity/v3/projects/197f43fa73664f3ba1f3dec8f1496634/users/cb9119fd30bb42d89d8996077f4720df/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:27.110648 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361d8bc-08e0-4c1c-822a-37be8281f9af admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:27.121160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361d8bc-08e0-4c1c-822a-37be8281f9af admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:27.184011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2394e-a054-4fda-8cb9-575784dd1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:27.184676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2394e-a054-4fda-8cb9-575784dd1c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:27.184960 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2394e-a054-4fda-8cb9-575784dd1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:27.185236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2394e-a054-4fda-8cb9-575784dd1c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:27.185990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2394e-a054-4fda-8cb9-575784dd1c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:27.187911 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2394e-a054-4fda-8cb9-575784dd1c49 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:27.198776 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1413/2833] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:27.203064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9b398-114b-46e9-86e0-2b28318fa90f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:27.214050 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9b398-114b-46e9-86e0-2b28318fa90f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:27.218629 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86b75-2b36-4dcf-b0dd-e9764e45269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:27.219505 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86b75-2b36-4dcf-b0dd-e9764e45269f admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:27.219787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86b75-2b36-4dcf-b0dd-e9764e45269f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:27.220061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86b75-2b36-4dcf-b0dd-e9764e45269f admin admin] PATH_INFO: `/v3/projects/197f43fa73664f3ba1f3dec8f1496634/users/cb9119fd30bb42d89d8996077f4720df/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:27.222111 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a86b75-2b36-4dcf-b0dd-e9764e45269f admin admin] RBAC: Authorizing `identity:create_grant(project_id=197f43fa73664f3ba1f3dec8f1496634, user_id=cb9119fd30bb42d89d8996077f4720df, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:27.224710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a86b75-2b36-4dcf-b0dd-e9764e45269f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:27.234705 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1421/2834] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:27 2022] PUT /identity/v3/projects/197f43fa73664f3ba1f3dec8f1496634/users/cb9119fd30bb42d89d8996077f4720df/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:27.244645 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8b3c9-03ba-4d55-9a06-6c388ba2faf7 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:27.244941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8b3c9-03ba-4d55-9a06-6c388ba2faf7 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:27.245223 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8b3c9-03ba-4d55-9a06-6c388ba2faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:27.271518 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-42e8b3c9-03ba-4d55-9a06-6c388ba2faf7 None None] MFA Rules not processed for user `cb9119fd30bb42d89d8996077f4720df`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:27.272711 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-42e8b3c9-03ba-4d55-9a06-6c388ba2faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:27.341453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1414/2835] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:27.352978 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86b75-2b36-4dcf-b0dd-e9764e45269f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:27.354735 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-21a86b75-2b36-4dcf-b0dd-e9764e45269f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:27.421790 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86b75-2b36-4dcf-b0dd-e9764e45269f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:27.425542 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f4847-c02e-4ef1-a42a-14a2679b462b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:27.426232 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f4847-c02e-4ef1-a42a-14a2679b462b service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:27.426525 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f4847-c02e-4ef1-a42a-14a2679b462b service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:27.426805 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f4847-c02e-4ef1-a42a-14a2679b462b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:27.436937 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f4847-c02e-4ef1-a42a-14a2679b462b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:27.438456 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f4847-c02e-4ef1-a42a-14a2679b462b service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:27.449662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1422/2836] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:27.522138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8b3c9-03ba-4d55-9a06-6c388ba2faf7 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:27.585449 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8b3c9-03ba-4d55-9a06-6c388ba2faf7 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:27.591209 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:27.592085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:27.592371 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:27.592651 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] PATH_INFO: `/v3/users/e40d86238b7f4c65a324c52684f64ef0` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:27.593923 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40d86238b7f4c65a324c52684f64ef0)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:27.595865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:27.834794 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40d86238b7f4c65a324c52684f64ef0'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:27.847260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40d86238b7f4c65a324c52684f64ef0'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:27.848002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40d86238b7f4c65a324c52684f64ef0'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:27.922177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40d86238b7f4c65a324c52684f64ef0'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:27.930777 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40d86238b7f4c65a324c52684f64ef0'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:27.936916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1415/2837] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:22:27 2022] DELETE /identity/v3/users/e40d86238b7f4c65a324c52684f64ef0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:27.941435 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef9bb-4a03-4245-bbe1-5715121172f6 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:27.946142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef9bb-4a03-4245-bbe1-5715121172f6 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:27.946142 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef9bb-4a03-4245-bbe1-5715121172f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:27.959407 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-7daef9bb-4a03-4245-bbe1-5715121172f6 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:27.960600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7daef9bb-4a03-4245-bbe1-5715121172f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:28.017239 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1423/2838] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:28.027324 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:28.029036 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:28.086083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a84fba-cb98-4b0b-8b58-bc082a39fa10 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:28.089782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb9dad-d794-4ea2-9c93-ef676665806a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:28.090431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb9dad-d794-4ea2-9c93-ef676665806a service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:28.090714 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb9dad-d794-4ea2-9c93-ef676665806a service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:28.090990 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb9dad-d794-4ea2-9c93-ef676665806a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:28.100085 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb9dad-d794-4ea2-9c93-ef676665806a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:28.102028 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb9dad-d794-4ea2-9c93-ef676665806a service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:28.111369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1416/2839] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:28.507100 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daef9bb-4a03-4245-bbe1-5715121172f6 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:28.508827 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-7daef9bb-4a03-4245-bbe1-5715121172f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:28.522275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daef9bb-4a03-4245-bbe1-5715121172f6 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:28.528363 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:28.529548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:28.529886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:28.530339 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] PATH_INFO: `/v3/projects/d600016087ca40b89edb0d75491dd0ba` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:28.531586 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d600016087ca40b89edb0d75491dd0ba)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:28.533626 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:28.656465 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd600016087ca40b89edb0d75491dd0ba', 'request_id': 'req-25b75067-7d55-4f2c-bac2-d57604b08de8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:28.662269 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd600016087ca40b89edb0d75491dd0ba', 'request_id': 'req-25b75067-7d55-4f2c-bac2-d57604b08de8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:28.757007 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd600016087ca40b89edb0d75491dd0ba', 'request_id': 'req-25b75067-7d55-4f2c-bac2-d57604b08de8'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:28.769510 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] The token cache is being invalidate because project d600016087ca40b89edb0d75491dd0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:22:28.769918 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:28.770613 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:28.772166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1424/2840] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:22:28 2022] DELETE /identity/v3/projects/d600016087ca40b89edb0d75491dd0ba => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:28.776967 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb9dad-d794-4ea2-9c93-ef676665806a service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:28.787024 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb9dad-d794-4ea2-9c93-ef676665806a service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:28.841765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:28.842663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:28.843062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:28.843352 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] PATH_INFO: `/v3/users/cb9119fd30bb42d89d8996077f4720df` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:28.844740 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9119fd30bb42d89d8996077f4720df)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:28.846730 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:29.038973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9119fd30bb42d89d8996077f4720df'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:29.051023 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9119fd30bb42d89d8996077f4720df'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:29.053525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9119fd30bb42d89d8996077f4720df'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:29.143112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9119fd30bb42d89d8996077f4720df'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:29.152109 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-787df985-aa6f-470c-910a-646093bd59fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9119fd30bb42d89d8996077f4720df'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:29.159011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1417/2841] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:22:28 2022] DELETE /identity/v3/users/cb9119fd30bb42d89d8996077f4720df => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:29.596575 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:29.598069 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:29.612433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b75067-7d55-4f2c-bac2-d57604b08de8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:29.672821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:29.673736 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:29.674014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:29.674294 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] PATH_INFO: `/v3/projects/197f43fa73664f3ba1f3dec8f1496634` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:29.675520 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] RBAC: Authorizing `identity:delete_project(project_id=197f43fa73664f3ba1f3dec8f1496634)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:29.677466 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:29.820987 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197f43fa73664f3ba1f3dec8f1496634', 'request_id': 'req-2e67e24f-074b-4397-adec-efa64e67069d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:29.826290 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197f43fa73664f3ba1f3dec8f1496634', 'request_id': 'req-2e67e24f-074b-4397-adec-efa64e67069d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:29.917471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197f43fa73664f3ba1f3dec8f1496634', 'request_id': 'req-2e67e24f-074b-4397-adec-efa64e67069d'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:29.930678 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] The token cache is being invalidate because project 197f43fa73664f3ba1f3dec8f1496634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:22:29.930971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:29.931624 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-2e67e24f-074b-4397-adec-efa64e67069d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:29.933163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1425/2842] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:22:29 2022] DELETE /identity/v3/projects/197f43fa73664f3ba1f3dec8f1496634 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:29.937973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a5b70-508b-4e4e-b9a4-74707bebb6d2 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:29.938485 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a5b70-508b-4e4e-b9a4-74707bebb6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:29.938586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a5b70-508b-4e4e-b9a4-74707bebb6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:29.957027 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-eb3a5b70-508b-4e4e-b9a4-74707bebb6d2 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:29.958282 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-eb3a5b70-508b-4e4e-b9a4-74707bebb6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:30.016062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1418/2843] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:30.024300 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13837954-97d0-40e4-92f6-b893ed8dcd3a None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:30.024534 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13837954-97d0-40e4-92f6-b893ed8dcd3a None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:30.024819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13837954-97d0-40e4-92f6-b893ed8dcd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:30.043537 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-13837954-97d0-40e4-92f6-b893ed8dcd3a None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:30.044739 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-13837954-97d0-40e4-92f6-b893ed8dcd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:30.052592 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1426/2844] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:22:30.056755 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a5b70-508b-4e4e-b9a4-74707bebb6d2 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:30.066280 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a5b70-508b-4e4e-b9a4-74707bebb6d2 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:30.071510 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7f519-68cd-4ab3-b1d0-05827f3a5caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:30.072221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f519-68cd-4ab3-b1d0-05827f3a5caa admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:30.072500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f519-68cd-4ab3-b1d0-05827f3a5caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:30.072770 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f519-68cd-4ab3-b1d0-05827f3a5caa admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:30.073529 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7f519-68cd-4ab3-b1d0-05827f3a5caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:22:30.073833 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7f519-68cd-4ab3-b1d0-05827f3a5caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:30.075411 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7f519-68cd-4ab3-b1d0-05827f3a5caa admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:30.087461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1419/2845] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:22:30.091724 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13837954-97d0-40e4-92f6-b893ed8dcd3a None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:30.100795 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13837954-97d0-40e4-92f6-b893ed8dcd3a None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:30.105674 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6ad7b-a9dd-432e-bfb4-dd651453a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:30.106324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6ad7b-a9dd-432e-bfb4-dd651453a6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:30.106614 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6ad7b-a9dd-432e-bfb4-dd651453a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:30.106895 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6ad7b-a9dd-432e-bfb4-dd651453a6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:30.107585 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6ad7b-a9dd-432e-bfb4-dd651453a6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:30.109544 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6ad7b-a9dd-432e-bfb4-dd651453a6d1 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:30.192589 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1427/2846] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:22:30 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:30.197512 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7f519-68cd-4ab3-b1d0-05827f3a5caa admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:30.207344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7f519-68cd-4ab3-b1d0-05827f3a5caa admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:30.263339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646c238-bf4d-4134-96bb-a94ec866c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:30.264011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646c238-bf4d-4134-96bb-a94ec866c3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:30.264290 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646c238-bf4d-4134-96bb-a94ec866c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:30.264573 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646c238-bf4d-4134-96bb-a94ec866c3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:30.265287 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646c238-bf4d-4134-96bb-a94ec866c3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:30.267225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646c238-bf4d-4134-96bb-a94ec866c3e9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:30.372115 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1420/2847] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:22:30 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:30.376182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6ad7b-a9dd-432e-bfb4-dd651453a6d1 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:30.387271 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6ad7b-a9dd-432e-bfb4-dd651453a6d1 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:30.391978 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e2d82-777e-4932-b248-1a0493f102a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:30.392641 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e2d82-777e-4932-b248-1a0493f102a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:30.392971 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e2d82-777e-4932-b248-1a0493f102a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:30.393255 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e2d82-777e-4932-b248-1a0493f102a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:30.394011 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e2d82-777e-4932-b248-1a0493f102a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:30.395731 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e2d82-777e-4932-b248-1a0493f102a8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:30.407397 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1428/2848] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:30.411521 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646c238-bf4d-4134-96bb-a94ec866c3e9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:30.421728 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646c238-bf4d-4134-96bb-a94ec866c3e9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:30.426824 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf37f99-9df2-4c1f-ac60-d21f81b3249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:30.427488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37f99-9df2-4c1f-ac60-d21f81b3249b admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:30.427774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37f99-9df2-4c1f-ac60-d21f81b3249b admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:30.428056 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37f99-9df2-4c1f-ac60-d21f81b3249b admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:30.428790 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf37f99-9df2-4c1f-ac60-d21f81b3249b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:30.431057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf37f99-9df2-4c1f-ac60-d21f81b3249b admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:30.440836 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1421/2849] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:30.445115 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e2d82-777e-4932-b248-1a0493f102a8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:30.455897 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e2d82-777e-4932-b248-1a0493f102a8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:30.460675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dff5ac-296d-451f-ae63-955c73c1555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:30.461715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dff5ac-296d-451f-ae63-955c73c1555d admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:30.462002 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dff5ac-296d-451f-ae63-955c73c1555d admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:30.462283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dff5ac-296d-451f-ae63-955c73c1555d admin admin] PATH_INFO: `/v3/projects/aaf49ac6e57f474a97683d6370b2b53a/users/5b942e41ab544527af8c84008f961dd4/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:30.476527 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dff5ac-296d-451f-ae63-955c73c1555d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf49ac6e57f474a97683d6370b2b53a, user_id=5b942e41ab544527af8c84008f961dd4, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:30.479230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dff5ac-296d-451f-ae63-955c73c1555d admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:30.555831 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1429/2850] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:30 2022] PUT /identity/v3/projects/aaf49ac6e57f474a97683d6370b2b53a/users/5b942e41ab544527af8c84008f961dd4/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:30.567224 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b05932-64f6-48e1-97e3-5f987ca1c548 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:30.567522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b05932-64f6-48e1-97e3-5f987ca1c548 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:30.567835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b05932-64f6-48e1-97e3-5f987ca1c548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:30.595391 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-96b05932-64f6-48e1-97e3-5f987ca1c548 None None] MFA Rules not processed for user `5b942e41ab544527af8c84008f961dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:30.596618 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-96b05932-64f6-48e1-97e3-5f987ca1c548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:30.659715 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1422/2851] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:30.664354 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dff5ac-296d-451f-ae63-955c73c1555d admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:30.726330 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dff5ac-296d-451f-ae63-955c73c1555d admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:30.731563 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1bc96-6a11-453e-9b2d-57cae0b5742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:30.732225 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1bc96-6a11-453e-9b2d-57cae0b5742e admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:30.732508 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1bc96-6a11-453e-9b2d-57cae0b5742e admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:30.732785 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1bc96-6a11-453e-9b2d-57cae0b5742e admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:30.733518 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1bc96-6a11-453e-9b2d-57cae0b5742e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:30.735404 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1bc96-6a11-453e-9b2d-57cae0b5742e admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:30.832495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1430/2852] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:22:30 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:30.837677 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b05932-64f6-48e1-97e3-5f987ca1c548 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:30.848546 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b05932-64f6-48e1-97e3-5f987ca1c548 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:30.906123 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a8203-3e92-47d6-8b72-e3c84c60e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:30.906734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a8203-3e92-47d6-8b72-e3c84c60e46c admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:30.907019 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a8203-3e92-47d6-8b72-e3c84c60e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:30.907300 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a8203-3e92-47d6-8b72-e3c84c60e46c admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:30.907993 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a8203-3e92-47d6-8b72-e3c84c60e46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:30.910003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a8203-3e92-47d6-8b72-e3c84c60e46c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:30.996274 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1423/2853] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:22:30 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:31.000335 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1bc96-6a11-453e-9b2d-57cae0b5742e admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:31.011316 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1bc96-6a11-453e-9b2d-57cae0b5742e admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:31.016532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cf84d-4a2f-4dd2-975e-4b46ce7100a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:31.017216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cf84d-4a2f-4dd2-975e-4b46ce7100a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:31.017590 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cf84d-4a2f-4dd2-975e-4b46ce7100a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:31.017873 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cf84d-4a2f-4dd2-975e-4b46ce7100a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:31.018600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cf84d-4a2f-4dd2-975e-4b46ce7100a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:31.020283 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cf84d-4a2f-4dd2-975e-4b46ce7100a8 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:31.031864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1431/2854] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:31.035996 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a8203-3e92-47d6-8b72-e3c84c60e46c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:31.046888 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a8203-3e92-47d6-8b72-e3c84c60e46c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:31.051696 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b631c-4ba5-49a6-9f47-e240882e1f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:31.052574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b631c-4ba5-49a6-9f47-e240882e1f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:31.052862 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b631c-4ba5-49a6-9f47-e240882e1f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:31.053145 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b631c-4ba5-49a6-9f47-e240882e1f2f admin admin] PATH_INFO: `/v3/projects/d3b32e5bf97e47a19b64b612fbb6808a/users/42b4ed93860a422f86c91d12ede8b101/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:31.068519 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b631c-4ba5-49a6-9f47-e240882e1f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b32e5bf97e47a19b64b612fbb6808a, user_id=42b4ed93860a422f86c91d12ede8b101, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:31.071385 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b631c-4ba5-49a6-9f47-e240882e1f2f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:31.156390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1424/2855] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:31 2022] PUT /identity/v3/projects/d3b32e5bf97e47a19b64b612fbb6808a/users/42b4ed93860a422f86c91d12ede8b101/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:31.160285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cf84d-4a2f-4dd2-975e-4b46ce7100a8 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:31.170915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cf84d-4a2f-4dd2-975e-4b46ce7100a8 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:31.233921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdbe99-1a73-49d5-ae3d-a6f55f24b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:31.234607 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdbe99-1a73-49d5-ae3d-a6f55f24b682 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:31.235034 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdbe99-1a73-49d5-ae3d-a6f55f24b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:31.235180 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdbe99-1a73-49d5-ae3d-a6f55f24b682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:31.236362 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdbe99-1a73-49d5-ae3d-a6f55f24b682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:31.237588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdbe99-1a73-49d5-ae3d-a6f55f24b682 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:31.252734 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1432/2856] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:31.254040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b631c-4ba5-49a6-9f47-e240882e1f2f admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:31.265200 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b631c-4ba5-49a6-9f47-e240882e1f2f admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:31.269924 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428798d9-28cb-41ea-9b85-9d05961d6815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:31.270806 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428798d9-28cb-41ea-9b85-9d05961d6815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:31.271093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428798d9-28cb-41ea-9b85-9d05961d6815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:31.271369 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428798d9-28cb-41ea-9b85-9d05961d6815 admin admin] PATH_INFO: `/v3/projects/d3b32e5bf97e47a19b64b612fbb6808a/users/42b4ed93860a422f86c91d12ede8b101/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:31.273988 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428798d9-28cb-41ea-9b85-9d05961d6815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b32e5bf97e47a19b64b612fbb6808a, user_id=42b4ed93860a422f86c91d12ede8b101, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:31.276662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428798d9-28cb-41ea-9b85-9d05961d6815 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:31.288186 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1425/2857] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:31 2022] PUT /identity/v3/projects/d3b32e5bf97e47a19b64b612fbb6808a/users/42b4ed93860a422f86c91d12ede8b101/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:31.299185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d1ecc-ee50-45dd-a4d5-9cd973a84b14 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:31.299487 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d1ecc-ee50-45dd-a4d5-9cd973a84b14 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:31.299812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d1ecc-ee50-45dd-a4d5-9cd973a84b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:31.330665 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-fa6d1ecc-ee50-45dd-a4d5-9cd973a84b14 None None] MFA Rules not processed for user `42b4ed93860a422f86c91d12ede8b101`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:31.332089 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-fa6d1ecc-ee50-45dd-a4d5-9cd973a84b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:31.402835 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1433/2858] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:31.413601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428798d9-28cb-41ea-9b85-9d05961d6815 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:31.415537 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-428798d9-28cb-41ea-9b85-9d05961d6815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:31.480928 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428798d9-28cb-41ea-9b85-9d05961d6815 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:31.484813 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250a279-df3e-4805-a0ed-08131ccc049a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:31.485538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a279-df3e-4805-a0ed-08131ccc049a service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:31.485819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a279-df3e-4805-a0ed-08131ccc049a service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:31.486093 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a279-df3e-4805-a0ed-08131ccc049a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:31.497344 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250a279-df3e-4805-a0ed-08131ccc049a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:31.498812 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250a279-df3e-4805-a0ed-08131ccc049a service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:31.510421 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1426/2859] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:31.616601 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d1ecc-ee50-45dd-a4d5-9cd973a84b14 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:31.627052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d1ecc-ee50-45dd-a4d5-9cd973a84b14 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:31.630704 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2367788-2834-4ae3-bd0e-483ae153c6e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:31.631386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2367788-2834-4ae3-bd0e-483ae153c6e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:31.631676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2367788-2834-4ae3-bd0e-483ae153c6e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:31.631951 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2367788-2834-4ae3-bd0e-483ae153c6e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:31.688700 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2367788-2834-4ae3-bd0e-483ae153c6e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:31.690075 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2367788-2834-4ae3-bd0e-483ae153c6e9 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:31.699817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1434/2860] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:34.725522 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250a279-df3e-4805-a0ed-08131ccc049a service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:34.789066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250a279-df3e-4805-a0ed-08131ccc049a service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:34.795039 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:34.795860 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:34.796148 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:34.796433 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] PATH_INFO: `/v3/users/5b942e41ab544527af8c84008f961dd4` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:34.797672 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b942e41ab544527af8c84008f961dd4)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:34.799995 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:34.975783 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b942e41ab544527af8c84008f961dd4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:34.988066 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b942e41ab544527af8c84008f961dd4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:34.988746 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b942e41ab544527af8c84008f961dd4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:35.054096 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b942e41ab544527af8c84008f961dd4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:35.063062 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b942e41ab544527af8c84008f961dd4'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:35.073490 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1427/2861] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:22:34 2022] DELETE /identity/v3/users/5b942e41ab544527af8c84008f961dd4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:35.075373 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91945d5-3e4f-45aa-bd16-30271fe810c7 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:35.075892 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91945d5-3e4f-45aa-bd16-30271fe810c7 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:35.075984 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91945d5-3e4f-45aa-bd16-30271fe810c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:35.093647 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-a91945d5-3e4f-45aa-bd16-30271fe810c7 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:35.094849 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a91945d5-3e4f-45aa-bd16-30271fe810c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:35.156551 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1435/2862] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:35.167947 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:35.169450 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:35.241863 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eee54-5afa-4545-ac1b-60d2a712d497 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:35.246177 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782c788-942e-474a-84b6-af8fdef0e5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:35.246845 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782c788-942e-474a-84b6-af8fdef0e5cc service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:35.248325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782c788-942e-474a-84b6-af8fdef0e5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:35.248325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782c788-942e-474a-84b6-af8fdef0e5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:35.257265 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782c788-942e-474a-84b6-af8fdef0e5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:35.258780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782c788-942e-474a-84b6-af8fdef0e5cc service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:35.268603 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1428/2863] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:35.804084 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91945d5-3e4f-45aa-bd16-30271fe810c7 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:35.805430 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-a91945d5-3e4f-45aa-bd16-30271fe810c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:35.817672 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91945d5-3e4f-45aa-bd16-30271fe810c7 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:35.822646 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:35.823690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:35.824052 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:35.824461 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] PATH_INFO: `/v3/projects/aaf49ac6e57f474a97683d6370b2b53a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:35.825740 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf49ac6e57f474a97683d6370b2b53a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:35.827725 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:35.939223 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf49ac6e57f474a97683d6370b2b53a', 'request_id': 'req-13e1e174-6b70-4768-8596-f7e4e5b03f7f'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:35.946578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf49ac6e57f474a97683d6370b2b53a', 'request_id': 'req-13e1e174-6b70-4768-8596-f7e4e5b03f7f'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:36.046659 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf49ac6e57f474a97683d6370b2b53a', 'request_id': 'req-13e1e174-6b70-4768-8596-f7e4e5b03f7f'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:36.060093 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] The token cache is being invalidate because project aaf49ac6e57f474a97683d6370b2b53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:22:36.060925 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:36.061100 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:36.062876 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1436/2864] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:22:35 2022] DELETE /identity/v3/projects/aaf49ac6e57f474a97683d6370b2b53a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:36.066900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782c788-942e-474a-84b6-af8fdef0e5cc service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:36.081156 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782c788-942e-474a-84b6-af8fdef0e5cc service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:36.144125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:36.145065 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:36.145390 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:36.145674 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] PATH_INFO: `/v3/users/42b4ed93860a422f86c91d12ede8b101` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:36.149011 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b4ed93860a422f86c91d12ede8b101)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:36.152592 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:36.372121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b4ed93860a422f86c91d12ede8b101'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:36.384654 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b4ed93860a422f86c91d12ede8b101'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:36.385456 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b4ed93860a422f86c91d12ede8b101'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:36.466382 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b4ed93860a422f86c91d12ede8b101'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:36.480441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-dfdbceb9-ecba-4686-b0aa-303fec1dfdde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b4ed93860a422f86c91d12ede8b101'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:36.483601 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1429/2865] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:22:36 2022] DELETE /identity/v3/users/42b4ed93860a422f86c91d12ede8b101 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:36.924753 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:36.927662 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:36.942720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1e174-6b70-4768-8596-f7e4e5b03f7f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:37.013948 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:37.014955 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:37.015267 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:37.015548 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] PATH_INFO: `/v3/projects/d3b32e5bf97e47a19b64b612fbb6808a` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:37.016742 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b32e5bf97e47a19b64b612fbb6808a)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:37.018695 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:37.157797 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b32e5bf97e47a19b64b612fbb6808a', 'request_id': 'req-461eebe5-be2a-4d44-891d-86828b2bea20'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:37.163440 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b32e5bf97e47a19b64b612fbb6808a', 'request_id': 'req-461eebe5-be2a-4d44-891d-86828b2bea20'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:37.265026 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b32e5bf97e47a19b64b612fbb6808a', 'request_id': 'req-461eebe5-be2a-4d44-891d-86828b2bea20'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:37.277763 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] The token cache is being invalidate because project d3b32e5bf97e47a19b64b612fbb6808a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:22:37.278055 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:37.278959 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-461eebe5-be2a-4d44-891d-86828b2bea20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:37.280559 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1437/2866] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:22:36 2022] DELETE /identity/v3/projects/d3b32e5bf97e47a19b64b612fbb6808a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:37.289339 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78906e6-e785-460a-9711-1afcea723a13 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:37.290318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78906e6-e785-460a-9711-1afcea723a13 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:37.290318 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78906e6-e785-460a-9711-1afcea723a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:37.308877 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-e78906e6-e785-460a-9711-1afcea723a13 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:37.310121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-e78906e6-e785-460a-9711-1afcea723a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:37.367547 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1430/2867] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:22:37.375623 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfeeb3-c860-4fcd-b6d5-59f6d6369283 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:37.375914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfeeb3-c860-4fcd-b6d5-59f6d6369283 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:37.376201 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfeeb3-c860-4fcd-b6d5-59f6d6369283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:37.394427 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-e6bfeeb3-c860-4fcd-b6d5-59f6d6369283 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:37.395715 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e6bfeeb3-c860-4fcd-b6d5-59f6d6369283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:37.404601 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1438/2868] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:37.408897 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78906e6-e785-460a-9711-1afcea723a13 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:37.419191 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78906e6-e785-460a-9711-1afcea723a13 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:37.423869 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16418f94-8118-40a3-b36f-0674fb77ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:37.424524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418f94-8118-40a3-b36f-0674fb77ad85 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:37.424811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418f94-8118-40a3-b36f-0674fb77ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:37.425095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418f94-8118-40a3-b36f-0674fb77ad85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:37.425854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16418f94-8118-40a3-b36f-0674fb77ad85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:22:37.426168 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16418f94-8118-40a3-b36f-0674fb77ad85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:37.427754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16418f94-8118-40a3-b36f-0674fb77ad85 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:37.440383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1431/2869] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:22:37.444663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfeeb3-c860-4fcd-b6d5-59f6d6369283 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:37.459048 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfeeb3-c860-4fcd-b6d5-59f6d6369283 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:37.465829 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1ac3-2745-416b-8683-5d8d0c0b1b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:37.466514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1ac3-2745-416b-8683-5d8d0c0b1b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:37.466802 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1ac3-2745-416b-8683-5d8d0c0b1b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:37.467083 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1ac3-2745-416b-8683-5d8d0c0b1b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:37.467804 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf1ac3-2745-416b-8683-5d8d0c0b1b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:37.469840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf1ac3-2745-416b-8683-5d8d0c0b1b59 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:37.564980 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1439/2870] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:22:37 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:37.569118 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16418f94-8118-40a3-b36f-0674fb77ad85 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:37.580149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16418f94-8118-40a3-b36f-0674fb77ad85 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:37.639302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb92e9-1b4b-416c-9a7b-0e07cdff831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:37.639980 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb92e9-1b4b-416c-9a7b-0e07cdff831c admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:37.640267 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb92e9-1b4b-416c-9a7b-0e07cdff831c admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:37.640550 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb92e9-1b4b-416c-9a7b-0e07cdff831c admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:37.641258 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb92e9-1b4b-416c-9a7b-0e07cdff831c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:37.643208 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb92e9-1b4b-416c-9a7b-0e07cdff831c admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:37.728904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1432/2871] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:22:37 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:37.733199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1ac3-2745-416b-8683-5d8d0c0b1b59 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:37.743794 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1ac3-2745-416b-8683-5d8d0c0b1b59 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:37.748600 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aee5aa-da26-4de2-a643-21eec5b11428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:37.749265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aee5aa-da26-4de2-a643-21eec5b11428 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:37.749588 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aee5aa-da26-4de2-a643-21eec5b11428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:37.749864 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aee5aa-da26-4de2-a643-21eec5b11428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:37.750596 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aee5aa-da26-4de2-a643-21eec5b11428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:37.752183 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aee5aa-da26-4de2-a643-21eec5b11428 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:37.763265 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1440/2872] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:37.767894 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb92e9-1b4b-416c-9a7b-0e07cdff831c admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:37.779190 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb92e9-1b4b-416c-9a7b-0e07cdff831c admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:37.783946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fe91f-bdbd-48e7-80bf-90419c22de98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:37.784745 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fe91f-bdbd-48e7-80bf-90419c22de98 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:37.784904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fe91f-bdbd-48e7-80bf-90419c22de98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:37.785188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fe91f-bdbd-48e7-80bf-90419c22de98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:37.785961 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fe91f-bdbd-48e7-80bf-90419c22de98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:37.787555 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fe91f-bdbd-48e7-80bf-90419c22de98 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:37.797584 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1433/2873] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:22:37.801949 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aee5aa-da26-4de2-a643-21eec5b11428 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:37.812092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aee5aa-da26-4de2-a643-21eec5b11428 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:37.817127 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04108040-68a6-4697-a9a7-9c6aef0c4374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:37.818076 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04108040-68a6-4697-a9a7-9c6aef0c4374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:37.818364 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04108040-68a6-4697-a9a7-9c6aef0c4374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:37.818644 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04108040-68a6-4697-a9a7-9c6aef0c4374 admin admin] PATH_INFO: `/v3/projects/d7f71df3cd4e4f1fbf22c7bcb20ec52e/users/5760e8e0d0cd42f1b5f6c6d565aca6cb/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:37.833812 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04108040-68a6-4697-a9a7-9c6aef0c4374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f71df3cd4e4f1fbf22c7bcb20ec52e, user_id=5760e8e0d0cd42f1b5f6c6d565aca6cb, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:37.836470 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04108040-68a6-4697-a9a7-9c6aef0c4374 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:37.900187 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1441/2874] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:37 2022] PUT /identity/v3/projects/d7f71df3cd4e4f1fbf22c7bcb20ec52e/users/5760e8e0d0cd42f1b5f6c6d565aca6cb/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:22:37.911861 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8711c7-c4ae-48b0-b3d4-cc69d151b322 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:37.912143 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8711c7-c4ae-48b0-b3d4-cc69d151b322 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:37.912428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8711c7-c4ae-48b0-b3d4-cc69d151b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:37.941016 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-1c8711c7-c4ae-48b0-b3d4-cc69d151b322 None None] MFA Rules not processed for user `5760e8e0d0cd42f1b5f6c6d565aca6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:37.942492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1c8711c7-c4ae-48b0-b3d4-cc69d151b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:38.017754 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1434/2875] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:38.021126 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04108040-68a6-4697-a9a7-9c6aef0c4374 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:38.086973 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04108040-68a6-4697-a9a7-9c6aef0c4374 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:38.092383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cbcc9-791f-4cfd-94f8-e5abe482a491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:38.093053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cbcc9-791f-4cfd-94f8-e5abe482a491 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:38.093532 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cbcc9-791f-4cfd-94f8-e5abe482a491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:38.093819 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cbcc9-791f-4cfd-94f8-e5abe482a491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:38.094519 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cbcc9-791f-4cfd-94f8-e5abe482a491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:38.096428 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cbcc9-791f-4cfd-94f8-e5abe482a491 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:38.172950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1442/2876] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:22:38 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:38.183459 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8711c7-c4ae-48b0-b3d4-cc69d151b322 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:38.195627 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8711c7-c4ae-48b0-b3d4-cc69d151b322 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:38.260157 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794891fc-061e-4958-9ce9-0864f0e4a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:38.261635 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794891fc-061e-4958-9ce9-0864f0e4a959 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:38.261904 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794891fc-061e-4958-9ce9-0864f0e4a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:38.262334 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794891fc-061e-4958-9ce9-0864f0e4a959 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:38.262935 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794891fc-061e-4958-9ce9-0864f0e4a959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:38.264854 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794891fc-061e-4958-9ce9-0864f0e4a959 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:38.368125 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1435/2877] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:22:38 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:22:38.373029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cbcc9-791f-4cfd-94f8-e5abe482a491 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:38.383137 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cbcc9-791f-4cfd-94f8-e5abe482a491 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:38.387825 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24d3da-4247-49e1-8fa3-3124ed357400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:38.388492 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d3da-4247-49e1-8fa3-3124ed357400 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:38.388776 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d3da-4247-49e1-8fa3-3124ed357400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:38.389054 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d3da-4247-49e1-8fa3-3124ed357400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:38.389821 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24d3da-4247-49e1-8fa3-3124ed357400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:38.391408 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24d3da-4247-49e1-8fa3-3124ed357400 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:38.403161 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1443/2878] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:38.407679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794891fc-061e-4958-9ce9-0864f0e4a959 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:38.419383 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794891fc-061e-4958-9ce9-0864f0e4a959 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:38.428260 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe16c-411f-4560-83ca-94b5e88b6df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:38.429195 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe16c-411f-4560-83ca-94b5e88b6df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:38.429501 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe16c-411f-4560-83ca-94b5e88b6df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:38.429933 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe16c-411f-4560-83ca-94b5e88b6df6 admin admin] PATH_INFO: `/v3/projects/fdceee0838664ae492570097718a92fa/users/f6e6125671cd453c8ef2a31b47543e3b/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:38.446538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fe16c-411f-4560-83ca-94b5e88b6df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdceee0838664ae492570097718a92fa, user_id=f6e6125671cd453c8ef2a31b47543e3b, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:38.449502 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fe16c-411f-4560-83ca-94b5e88b6df6 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:38.512002 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1436/2879] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:38 2022] PUT /identity/v3/projects/fdceee0838664ae492570097718a92fa/users/f6e6125671cd453c8ef2a31b47543e3b/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:38.516079 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24d3da-4247-49e1-8fa3-3124ed357400 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:38.527014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24d3da-4247-49e1-8fa3-3124ed357400 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:38.589415 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad834530-d7e0-44d7-a42d-b7dbefe6e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:38.590095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834530-d7e0-44d7-a42d-b7dbefe6e77e admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:38.590395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834530-d7e0-44d7-a42d-b7dbefe6e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:38.590676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834530-d7e0-44d7-a42d-b7dbefe6e77e admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:38.591409 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad834530-d7e0-44d7-a42d-b7dbefe6e77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:38.592999 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad834530-d7e0-44d7-a42d-b7dbefe6e77e admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:38.602687 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1444/2880] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:38.607738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe16c-411f-4560-83ca-94b5e88b6df6 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:38.618381 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe16c-411f-4560-83ca-94b5e88b6df6 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:38.623526 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f3004-4618-4df4-8619-db389213d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:38.624413 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3004-4618-4df4-8619-db389213d200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:38.624694 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3004-4618-4df4-8619-db389213d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:38.624971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3004-4618-4df4-8619-db389213d200 admin admin] PATH_INFO: `/v3/projects/fdceee0838664ae492570097718a92fa/users/f6e6125671cd453c8ef2a31b47543e3b/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:38.627003 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f3004-4618-4df4-8619-db389213d200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdceee0838664ae492570097718a92fa, user_id=f6e6125671cd453c8ef2a31b47543e3b, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:38.629653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f3004-4618-4df4-8619-db389213d200 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:38.640247 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1437/2881] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:38 2022] PUT /identity/v3/projects/fdceee0838664ae492570097718a92fa/users/f6e6125671cd453c8ef2a31b47543e3b/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:22:38.650414 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1be54-0072-4776-8416-2c63a50c3ef9 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:38.650720 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1be54-0072-4776-8416-2c63a50c3ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:38.651597 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1be54-0072-4776-8416-2c63a50c3ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:38.679818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-84d1be54-0072-4776-8416-2c63a50c3ef9 None None] MFA Rules not processed for user `f6e6125671cd453c8ef2a31b47543e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:38.681041 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-84d1be54-0072-4776-8416-2c63a50c3ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:38.767132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1445/2882] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:38.779451 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f3004-4618-4df4-8619-db389213d200 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:38.781303 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-189f3004-4618-4df4-8619-db389213d200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:38.839599 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f3004-4618-4df4-8619-db389213d200 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:38.843252 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce432c4-1a2b-4be0-b674-3ac00f64fad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:38.843914 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce432c4-1a2b-4be0-b674-3ac00f64fad7 service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:38.844225 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce432c4-1a2b-4be0-b674-3ac00f64fad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:38.844508 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce432c4-1a2b-4be0-b674-3ac00f64fad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:38.903050 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce432c4-1a2b-4be0-b674-3ac00f64fad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:38.904650 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce432c4-1a2b-4be0-b674-3ac00f64fad7 service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:38.913495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1438/2883] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:39.086651 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1be54-0072-4776-8416-2c63a50c3ef9 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:39.088106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-84d1be54-0072-4776-8416-2c63a50c3ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:39.169950 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1be54-0072-4776-8416-2c63a50c3ef9 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:39.175351 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8741fe-dbdc-4f50-9fbc-f8fa2ecfa24d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:39.176079 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8741fe-dbdc-4f50-9fbc-f8fa2ecfa24d service placement] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:39.176395 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8741fe-dbdc-4f50-9fbc-f8fa2ecfa24d service placement] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:39.176671 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8741fe-dbdc-4f50-9fbc-f8fa2ecfa24d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:39.178476 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-da8741fe-dbdc-4f50-9fbc-f8fa2ecfa24d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:39.191019 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8741fe-dbdc-4f50-9fbc-f8fa2ecfa24d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:39.192857 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8741fe-dbdc-4f50-9fbc-f8fa2ecfa24d service placement] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:39.204355 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1446/2884] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:43.970251 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce432c4-1a2b-4be0-b674-3ac00f64fad7 service cinder] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:43.971748 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6ce432c4-1a2b-4be0-b674-3ac00f64fad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:43.983834 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce432c4-1a2b-4be0-b674-3ac00f64fad7 service cinder] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:43.987477 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38af6a8-3aed-418b-9bd5-03f0c9f6522c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:43.988121 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af6a8-3aed-418b-9bd5-03f0c9f6522c service cinder] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:43.988472 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af6a8-3aed-418b-9bd5-03f0c9f6522c service cinder] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:43.988676 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af6a8-3aed-418b-9bd5-03f0c9f6522c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:43.997971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38af6a8-3aed-418b-9bd5-03f0c9f6522c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:43.999379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38af6a8-3aed-418b-9bd5-03f0c9f6522c service cinder] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:44.008679 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1439/2885] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:50.091886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8741fe-dbdc-4f50-9fbc-f8fa2ecfa24d service placement] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:50.151886 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8741fe-dbdc-4f50-9fbc-f8fa2ecfa24d service placement] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:50.157635 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:50.158507 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:50.158796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:50.159079 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] PATH_INFO: `/v3/users/5760e8e0d0cd42f1b5f6c6d565aca6cb` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:50.160324 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5760e8e0d0cd42f1b5f6c6d565aca6cb)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:50.162277 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:50.328869 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5760e8e0d0cd42f1b5f6c6d565aca6cb'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:50.329554 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5760e8e0d0cd42f1b5f6c6d565aca6cb'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:50.330185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5760e8e0d0cd42f1b5f6c6d565aca6cb'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:50.341880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5760e8e0d0cd42f1b5f6c6d565aca6cb'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:50.348803 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5760e8e0d0cd42f1b5f6c6d565aca6cb'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:50.435053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1447/2886] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:22:50 2022] DELETE /identity/v3/users/5760e8e0d0cd42f1b5f6c6d565aca6cb => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:50.439717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa78208-47e3-4da6-945f-1421f70b5750 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:50.440222 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa78208-47e3-4da6-945f-1421f70b5750 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:50.440341 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa78208-47e3-4da6-945f-1421f70b5750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:50.458570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-cfa78208-47e3-4da6-945f-1421f70b5750 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:50.459774 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cfa78208-47e3-4da6-945f-1421f70b5750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:50.516865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1440/2887] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:50.526477 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:50.528262 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:50.584521 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a4b1d-92e1-4095-8b39-4bd81b9ac1c5 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:50.588367 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f52932-c4b1-4d16-a1c8-e71bf79a58dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:50.589017 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f52932-c4b1-4d16-a1c8-e71bf79a58dc service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:50.589405 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f52932-c4b1-4d16-a1c8-e71bf79a58dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:50.589690 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f52932-c4b1-4d16-a1c8-e71bf79a58dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:50.602771 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f52932-c4b1-4d16-a1c8-e71bf79a58dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:50.613400 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f52932-c4b1-4d16-a1c8-e71bf79a58dc service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:50.621253 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1448/2888] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 21:22:51.009921 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa78208-47e3-4da6-945f-1421f70b5750 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:51.012040 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-cfa78208-47e3-4da6-945f-1421f70b5750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:51.023798 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa78208-47e3-4da6-945f-1421f70b5750 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:51.030474 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:51.031356 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:51.031644 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:51.037149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] PATH_INFO: `/v3/projects/d7f71df3cd4e4f1fbf22c7bcb20ec52e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:51.037149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f71df3cd4e4f1fbf22c7bcb20ec52e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:51.037149 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:51.174327 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f71df3cd4e4f1fbf22c7bcb20ec52e', 'request_id': 'req-371413bd-d5d1-46b9-9855-c0644d83565d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:51.179524 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f71df3cd4e4f1fbf22c7bcb20ec52e', 'request_id': 'req-371413bd-d5d1-46b9-9855-c0644d83565d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:51.264946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f71df3cd4e4f1fbf22c7bcb20ec52e', 'request_id': 'req-371413bd-d5d1-46b9-9855-c0644d83565d'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:51.276084 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] The token cache is being invalidate because project d7f71df3cd4e4f1fbf22c7bcb20ec52e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:22:51.276370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:51.277570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:51.279365 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1441/2889] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:22:51 2022] DELETE /identity/v3/projects/d7f71df3cd4e4f1fbf22c7bcb20ec52e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:51.283445 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f52932-c4b1-4d16-a1c8-e71bf79a58dc service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:51.294063 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f52932-c4b1-4d16-a1c8-e71bf79a58dc service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:51.347663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:51.348530 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:51.348813 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:51.349094 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] PATH_INFO: `/v3/users/f6e6125671cd453c8ef2a31b47543e3b` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:51.350291 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e6125671cd453c8ef2a31b47543e3b)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:51.352202 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:51.579317 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e6125671cd453c8ef2a31b47543e3b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:51.579893 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e6125671cd453c8ef2a31b47543e3b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:51.580494 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e6125671cd453c8ef2a31b47543e3b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:51.593472 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e6125671cd453c8ef2a31b47543e3b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:51.600266 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-37c65450-a1c8-4821-b41e-0bd1aeff9b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e6125671cd453c8ef2a31b47543e3b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:51.680015 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1449/2890] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:22:51 2022] DELETE /identity/v3/users/f6e6125671cd453c8ef2a31b47543e3b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:52.093254 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:52.094772 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:52.108289 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371413bd-d5d1-46b9-9855-c0644d83565d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:52.176717 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:52.177630 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:52.177908 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:52.178184 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] PATH_INFO: `/v3/projects/fdceee0838664ae492570097718a92fa` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:52.179586 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdceee0838664ae492570097718a92fa)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:52.181565 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:52.292064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdceee0838664ae492570097718a92fa', 'request_id': 'req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:52.298329 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdceee0838664ae492570097718a92fa', 'request_id': 'req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:52.372445 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdceee0838664ae492570097718a92fa', 'request_id': 'req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:52.384273 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] The token cache is being invalidate because project fdceee0838664ae492570097718a92fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:22:52.384610 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:52.385242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-d07d165c-3110-4fd8-9fb9-6d10b5d0bda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:52.390653 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1442/2891] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:22:52 2022] DELETE /identity/v3/projects/fdceee0838664ae492570097718a92fa => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:52.393314 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d880d-55d3-4b3e-b8a3-79f660db235d None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:52.393762 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d880d-55d3-4b3e-b8a3-79f660db235d None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:52.393880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d880d-55d3-4b3e-b8a3-79f660db235d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:52.412880 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-3f0d880d-55d3-4b3e-b8a3-79f660db235d None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:52.414102 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-3f0d880d-55d3-4b3e-b8a3-79f660db235d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:52.472160 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1450/2892] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:52.482138 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d44da-9ce2-4d06-bc05-a8c76462b10e None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:52.482428 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d44da-9ce2-4d06-bc05-a8c76462b10e None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:52.482738 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d44da-9ce2-4d06-bc05-a8c76462b10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:52.501325 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-ac0d44da-9ce2-4d06-bc05-a8c76462b10e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:52.502549 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-ac0d44da-9ce2-4d06-bc05-a8c76462b10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:52.510534 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1443/2893] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 21:22:52.515170 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d880d-55d3-4b3e-b8a3-79f660db235d None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:52.525047 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d880d-55d3-4b3e-b8a3-79f660db235d None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:52.530723 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b8a57-7b69-46f2-b03c-5bcfac5c153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:52.531386 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8a57-7b69-46f2-b03c-5bcfac5c153a admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:52.531676 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8a57-7b69-46f2-b03c-5bcfac5c153a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:52.531960 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b8a57-7b69-46f2-b03c-5bcfac5c153a admin admin] PATH_INFO: `/v3/domains` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:52.532689 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b8a57-7b69-46f2-b03c-5bcfac5c153a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:22:52.533003 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b8a57-7b69-46f2-b03c-5bcfac5c153a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:52.534666 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b8a57-7b69-46f2-b03c-5bcfac5c153a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:52.547090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1451/2894] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:22:52.551492 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d44da-9ce2-4d06-bc05-a8c76462b10e None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:52.561917 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d44da-9ce2-4d06-bc05-a8c76462b10e None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:52.566538 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae1c2-9287-471e-a5a9-88cb4c6eded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:52.567189 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae1c2-9287-471e-a5a9-88cb4c6eded9 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:52.567471 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae1c2-9287-471e-a5a9-88cb4c6eded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:52.567744 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae1c2-9287-471e-a5a9-88cb4c6eded9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:52.568429 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ae1c2-9287-471e-a5a9-88cb4c6eded9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:52.570350 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ae1c2-9287-471e-a5a9-88cb4c6eded9 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:52.647971 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1444/2895] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:22:52 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:52.652495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b8a57-7b69-46f2-b03c-5bcfac5c153a admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:52.662856 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b8a57-7b69-46f2-b03c-5bcfac5c153a admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:52.737978 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58142f4a-16fb-428a-bc2c-46f493de8f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:52.738818 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58142f4a-16fb-428a-bc2c-46f493de8f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:52.739106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58142f4a-16fb-428a-bc2c-46f493de8f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:52.739387 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58142f4a-16fb-428a-bc2c-46f493de8f8b admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:52.740095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58142f4a-16fb-428a-bc2c-46f493de8f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:52.742078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58142f4a-16fb-428a-bc2c-46f493de8f8b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:52.818326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1452/2896] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:22:52 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 21:22:52.823074 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae1c2-9287-471e-a5a9-88cb4c6eded9 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:52.834373 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae1c2-9287-471e-a5a9-88cb4c6eded9 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:52.839570 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e0ac-7317-40b7-8f46-f53afa828964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:52.841172 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e0ac-7317-40b7-8f46-f53afa828964 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:52.841354 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e0ac-7317-40b7-8f46-f53afa828964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:52.841646 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e0ac-7317-40b7-8f46-f53afa828964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:52.842388 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804e0ac-7317-40b7-8f46-f53afa828964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:52.844057 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804e0ac-7317-40b7-8f46-f53afa828964 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:52.855073 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1445/2897] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 21:22:52.861112 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58142f4a-16fb-428a-bc2c-46f493de8f8b admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:52.871179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58142f4a-16fb-428a-bc2c-46f493de8f8b admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:52.875817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1408cb-e5c7-4bf0-9826-42ee5a75a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:52.876471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1408cb-e5c7-4bf0-9826-42ee5a75a41a admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:52.876756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1408cb-e5c7-4bf0-9826-42ee5a75a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:52.877156 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1408cb-e5c7-4bf0-9826-42ee5a75a41a admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:52.877917 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1408cb-e5c7-4bf0-9826-42ee5a75a41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:52.879495 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1408cb-e5c7-4bf0-9826-42ee5a75a41a admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:52.890241 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1453/2898] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:52.894634 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e0ac-7317-40b7-8f46-f53afa828964 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:52.905747 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e0ac-7317-40b7-8f46-f53afa828964 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:52.910916 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045842e-5657-4292-a6bd-c2e5f620b83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:52.911819 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045842e-5657-4292-a6bd-c2e5f620b83d admin admin] REQUEST_METHOD: `PUT` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:52.912110 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045842e-5657-4292-a6bd-c2e5f620b83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:52.912398 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045842e-5657-4292-a6bd-c2e5f620b83d admin admin] PATH_INFO: `/v3/projects/f082efbb42a34713ab79e1a3f640428c/users/e51e9562731b4888a007cfd8f2be6230/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:52.927151 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045842e-5657-4292-a6bd-c2e5f620b83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f082efbb42a34713ab79e1a3f640428c, user_id=e51e9562731b4888a007cfd8f2be6230, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:52.929851 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045842e-5657-4292-a6bd-c2e5f620b83d admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:53.008706 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1446/2899] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:52 2022] PUT /identity/v3/projects/f082efbb42a34713ab79e1a3f640428c/users/e51e9562731b4888a007cfd8f2be6230/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:53.020333 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec1c1-e859-49ae-9c59-66441e784510 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:53.020632 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec1c1-e859-49ae-9c59-66441e784510 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:53.020921 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec1c1-e859-49ae-9c59-66441e784510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:53.049136 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-b8fec1c1-e859-49ae-9c59-66441e784510 None None] MFA Rules not processed for user `e51e9562731b4888a007cfd8f2be6230`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:53.050379 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-b8fec1c1-e859-49ae-9c59-66441e784510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:53.112930 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1454/2900] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:53.117577 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045842e-5657-4292-a6bd-c2e5f620b83d admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:53.179379 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045842e-5657-4292-a6bd-c2e5f620b83d admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:53.184080 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06eead4-5a64-4823-8304-30573458b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:53.184742 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06eead4-5a64-4823-8304-30573458b116 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:53.185030 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06eead4-5a64-4823-8304-30573458b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:53.185346 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06eead4-5a64-4823-8304-30573458b116 admin admin] PATH_INFO: `/v3/projects` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:53.186058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06eead4-5a64-4823-8304-30573458b116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:53.187956 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06eead4-5a64-4823-8304-30573458b116 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:53.260407 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1447/2901] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:22:53 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:53.265368 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec1c1-e859-49ae-9c59-66441e784510 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:53.276663 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec1c1-e859-49ae-9c59-66441e784510 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:53.330969 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26ed1-c0e0-42a2-a9fb-88dd70fbecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:53.331648 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26ed1-c0e0-42a2-a9fb-88dd70fbecac admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:53.331931 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26ed1-c0e0-42a2-a9fb-88dd70fbecac admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:53.332211 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d26ed1-c0e0-42a2-a9fb-88dd70fbecac admin admin] PATH_INFO: `/v3/users` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:53.332907 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d26ed1-c0e0-42a2-a9fb-88dd70fbecac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:53.334836 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d26ed1-c0e0-42a2-a9fb-88dd70fbecac admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:53.417369 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1455/2902] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:22:53 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:53.421809 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06eead4-5a64-4823-8304-30573458b116 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:53.432036 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06eead4-5a64-4823-8304-30573458b116 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:53.437574 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418351e-0034-4aed-ac50-42c183ab48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:53.438281 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418351e-0034-4aed-ac50-42c183ab48b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:53.438561 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418351e-0034-4aed-ac50-42c183ab48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:53.438835 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418351e-0034-4aed-ac50-42c183ab48b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:53.439557 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418351e-0034-4aed-ac50-42c183ab48b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:53.441153 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418351e-0034-4aed-ac50-42c183ab48b7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:53.453397 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1448/2903] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:53.457571 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26ed1-c0e0-42a2-a9fb-88dd70fbecac admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:53.467914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d26ed1-c0e0-42a2-a9fb-88dd70fbecac admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:53.473091 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abe681-21ad-41cc-a231-fb080f762328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:53.474014 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abe681-21ad-41cc-a231-fb080f762328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:53.474305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abe681-21ad-41cc-a231-fb080f762328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:53.474585 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abe681-21ad-41cc-a231-fb080f762328 admin admin] PATH_INFO: `/v3/projects/2c31371f8de04c87963db11462fe4065/users/7879450e12f4432cb78a0ee5802d3011/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:53.489655 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abe681-21ad-41cc-a231-fb080f762328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c31371f8de04c87963db11462fe4065, user_id=7879450e12f4432cb78a0ee5802d3011, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:53.492372 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abe681-21ad-41cc-a231-fb080f762328 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:53.578916 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1456/2904] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:53 2022] PUT /identity/v3/projects/2c31371f8de04c87963db11462fe4065/users/7879450e12f4432cb78a0ee5802d3011/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:53.582807 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418351e-0034-4aed-ac50-42c183ab48b7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:53.593593 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418351e-0034-4aed-ac50-42c183ab48b7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:53.647731 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501937ba-3351-4f95-b19c-20a79cf16c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:53.648395 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501937ba-3351-4f95-b19c-20a79cf16c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:53.648678 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501937ba-3351-4f95-b19c-20a79cf16c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:53.648952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501937ba-3351-4f95-b19c-20a79cf16c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:53.649703 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501937ba-3351-4f95-b19c-20a79cf16c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:53.651430 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501937ba-3351-4f95-b19c-20a79cf16c61 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:53.665236 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1449/2905] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:53.669863 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abe681-21ad-41cc-a231-fb080f762328 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:53.680490 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abe681-21ad-41cc-a231-fb080f762328 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:53.685615 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef9f92-4bb6-4191-947e-006ab6e0c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:53.686576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef9f92-4bb6-4191-947e-006ab6e0c00c admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:53.686914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef9f92-4bb6-4191-947e-006ab6e0c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:53.687251 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef9f92-4bb6-4191-947e-006ab6e0c00c admin admin] PATH_INFO: `/v3/projects/2c31371f8de04c87963db11462fe4065/users/7879450e12f4432cb78a0ee5802d3011/roles/4ae0665802b946be870ab06274297a1d` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:53.689182 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef9f92-4bb6-4191-947e-006ab6e0c00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c31371f8de04c87963db11462fe4065, user_id=7879450e12f4432cb78a0ee5802d3011, role_id=4ae0665802b946be870ab06274297a1d)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:53.691817 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef9f92-4bb6-4191-947e-006ab6e0c00c admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:53.703106 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1457/2906] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:53 2022] PUT /identity/v3/projects/2c31371f8de04c87963db11462fe4065/users/7879450e12f4432cb78a0ee5802d3011/roles/4ae0665802b946be870ab06274297a1d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 21:22:53.713660 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfdead-6a58-43fb-938f-e4ecff05b1e8 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:53.713951 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfdead-6a58-43fb-938f-e4ecff05b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:53.714235 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfdead-6a58-43fb-938f-e4ecff05b1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:53.741825 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-79bfdead-6a58-43fb-938f-e4ecff05b1e8 None None] MFA Rules not processed for user `7879450e12f4432cb78a0ee5802d3011`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:53.747765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-79bfdead-6a58-43fb-938f-e4ecff05b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:53.810469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1450/2907] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:53.821854 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef9f92-4bb6-4191-947e-006ab6e0c00c admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:53.823559 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-73ef9f92-4bb6-4191-947e-006ab6e0c00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:53.881439 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef9f92-4bb6-4191-947e-006ab6e0c00c admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:53.885517 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0291bcb-e918-4b4e-bd38-375d4ada9280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:53.886166 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0291bcb-e918-4b4e-bd38-375d4ada9280 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:53.886453 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0291bcb-e918-4b4e-bd38-375d4ada9280 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:53.886733 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0291bcb-e918-4b4e-bd38-375d4ada9280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:53.943237 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0291bcb-e918-4b4e-bd38-375d4ada9280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:53.944675 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0291bcb-e918-4b4e-bd38-375d4ada9280 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:53.954070 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1458/2908] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:57.040112 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfdead-6a58-43fb-938f-e4ecff05b1e8 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:57.099094 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfdead-6a58-43fb-938f-e4ecff05b1e8 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:57.103765 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:57.104631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:57.104942 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:57.105221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] PATH_INFO: `/v3/users/e51e9562731b4888a007cfd8f2be6230` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:57.106486 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51e9562731b4888a007cfd8f2be6230)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:57.108484 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:57.261636 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51e9562731b4888a007cfd8f2be6230'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:57.273585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51e9562731b4888a007cfd8f2be6230'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:57.274253 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51e9562731b4888a007cfd8f2be6230'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:57.348294 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51e9562731b4888a007cfd8f2be6230'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:57.355469 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51e9562731b4888a007cfd8f2be6230'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:57.361900 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1451/2909] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:22:57 2022] DELETE /identity/v3/users/e51e9562731b4888a007cfd8f2be6230 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:57.366598 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ecbef-7d71-4897-85e3-ac0b1a4e9e4e None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:57.367059 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ecbef-7d71-4897-85e3-ac0b1a4e9e4e None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:57.367149 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ecbef-7d71-4897-85e3-ac0b1a4e9e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:57.384935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-d34ecbef-7d71-4897-85e3-ac0b1a4e9e4e None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:57.386164 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d34ecbef-7d71-4897-85e3-ac0b1a4e9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:57.443029 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1459/2910] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:57.453242 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:57.454708 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:57.510425 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6a26a-6dd5-4ebf-a5a3-a43348b76331 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:57.514488 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61673217-a132-4a8e-8275-d58cf333ac32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:57.515076 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61673217-a132-4a8e-8275-d58cf333ac32 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:57.515357 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61673217-a132-4a8e-8275-d58cf333ac32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:57.515631 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61673217-a132-4a8e-8275-d58cf333ac32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:57.524396 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61673217-a132-4a8e-8275-d58cf333ac32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:57.525865 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61673217-a132-4a8e-8275-d58cf333ac32 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:57.539212 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1452/2911] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:22:57.933344 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ecbef-7d71-4897-85e3-ac0b1a4e9e4e None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:57.935601 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-d34ecbef-7d71-4897-85e3-ac0b1a4e9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:57.947319 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ecbef-7d71-4897-85e3-ac0b1a4e9e4e None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:57.952230 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:57.953122 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:57.953438 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:57.953719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] PATH_INFO: `/v3/projects/f082efbb42a34713ab79e1a3f640428c` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:57.954910 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f082efbb42a34713ab79e1a3f640428c)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:57.956961 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:58.062844 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f082efbb42a34713ab79e1a3f640428c', 'request_id': 'req-6a964316-0f1f-441d-922f-90e1b8226d3f'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:58.068327 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f082efbb42a34713ab79e1a3f640428c', 'request_id': 'req-6a964316-0f1f-441d-922f-90e1b8226d3f'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:58.114512 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f082efbb42a34713ab79e1a3f640428c', 'request_id': 'req-6a964316-0f1f-441d-922f-90e1b8226d3f'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:58.126693 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] The token cache is being invalidate because project f082efbb42a34713ab79e1a3f640428c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:22:58.126981 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:58.127622 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:58.129174 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1460/2912] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:22:57 2022] DELETE /identity/v3/projects/f082efbb42a34713ab79e1a3f640428c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:58.133340 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61673217-a132-4a8e-8275-d58cf333ac32 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:58.143734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61673217-a132-4a8e-8275-d58cf333ac32 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:58.197896 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:58.198790 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:58.199083 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:58.199368 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] PATH_INFO: `/v3/users/7879450e12f4432cb78a0ee5802d3011` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:58.201160 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7879450e12f4432cb78a0ee5802d3011)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:58.203098 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:58.358375 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7879450e12f4432cb78a0ee5802d3011'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:58.369941 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7879450e12f4432cb78a0ee5802d3011'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:58.370623 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7879450e12f4432cb78a0ee5802d3011'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:58.411304 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7879450e12f4432cb78a0ee5802d3011'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:58.419461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-6df770db-5cb2-43a6-8c31-a07d53122a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7879450e12f4432cb78a0ee5802d3011'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:58.428605 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1453/2913] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:22:58 2022] DELETE /identity/v3/users/7879450e12f4432cb78a0ee5802d3011 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:58.832738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:58.834305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:58.848870 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a964316-0f1f-441d-922f-90e1b8226d3f admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:58.913796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:58.913796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:58.913796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:58.913796 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] PATH_INFO: `/v3/projects/2c31371f8de04c87963db11462fe4065` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:58.914383 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c31371f8de04c87963db11462fe4065)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:58.915850 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:59.008815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c31371f8de04c87963db11462fe4065', 'request_id': 'req-9c41bf31-3099-4910-9c55-60d04973115b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:59.014185 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c31371f8de04c87963db11462fe4065', 'request_id': 'req-9c41bf31-3099-4910-9c55-60d04973115b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:59.096841 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c31371f8de04c87963db11462fe4065', 'request_id': 'req-9c41bf31-3099-4910-9c55-60d04973115b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:59.108775 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] The token cache is being invalidate because project 2c31371f8de04c87963db11462fe4065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:22:59.109090 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:59.109769 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-9c41bf31-3099-4910-9c55-60d04973115b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:22:59.111334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1461/2914] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:22:58 2022] DELETE /identity/v3/projects/2c31371f8de04c87963db11462fe4065 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:59.116370 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eea51-9f40-4e56-8ab1-86383bca1a63 None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:59.116664 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eea51-9f40-4e56-8ab1-86383bca1a63 None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:59.116948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eea51-9f40-4e56-8ab1-86383bca1a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:59.136029 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-249eea51-9f40-4e56-8ab1-86383bca1a63 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:59.137238 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-249eea51-9f40-4e56-8ab1-86383bca1a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:59.195453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1454/2915] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:59.203989 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49d88a-d9fd-452f-8f53-3170124cd6e3 None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:59.204285 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49d88a-d9fd-452f-8f53-3170124cd6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:59.204571 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49d88a-d9fd-452f-8f53-3170124cd6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:59.223227 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-8a49d88a-d9fd-452f-8f53-3170124cd6e3 None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:59.224433 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-8a49d88a-d9fd-452f-8f53-3170124cd6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:59.233378 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1462/2916] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:59.237932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eea51-9f40-4e56-8ab1-86383bca1a63 None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:59.247734 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eea51-9f40-4e56-8ab1-86383bca1a63 None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:59.252661 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bca70f-957b-4184-8b98-0c62bfaf6853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:59.253347 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bca70f-957b-4184-8b98-0c62bfaf6853 admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:59.253642 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bca70f-957b-4184-8b98-0c62bfaf6853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:59.253930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bca70f-957b-4184-8b98-0c62bfaf6853 admin admin] PATH_INFO: `/v3/domains` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:59.254664 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bca70f-957b-4184-8b98-0c62bfaf6853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 21:22:59.254975 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bca70f-957b-4184-8b98-0c62bfaf6853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:59.256558 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bca70f-957b-4184-8b98-0c62bfaf6853 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:59.268048 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1455/2917] 10.222.0.59 () {58 vars in 1152 bytes} [Thu May 12 21:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 21:22:59.272228 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49d88a-d9fd-452f-8f53-3170124cd6e3 None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:59.282562 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49d88a-d9fd-452f-8f53-3170124cd6e3 None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:59.287233 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79fff6-b15a-4436-bac6-342c1e0bfa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:59.287908 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79fff6-b15a-4436-bac6-342c1e0bfa18 admin admin] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:59.288194 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79fff6-b15a-4436-bac6-342c1e0bfa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:59.288474 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79fff6-b15a-4436-bac6-342c1e0bfa18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:59.289162 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79fff6-b15a-4436-bac6-342c1e0bfa18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:59.291092 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79fff6-b15a-4436-bac6-342c1e0bfa18 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:59.372399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1463/2918] 10.222.0.59 () {60 vars in 1152 bytes} [Thu May 12 21:22:59 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:59.376578 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bca70f-957b-4184-8b98-0c62bfaf6853 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:59.386355 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bca70f-957b-4184-8b98-0c62bfaf6853 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:59.443000 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dc81a-15d5-4479-a293-c4011c0311a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:59.443662 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dc81a-15d5-4479-a293-c4011c0311a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:59.443946 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dc81a-15d5-4479-a293-c4011c0311a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:59.444228 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dc81a-15d5-4479-a293-c4011c0311a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:59.444926 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dc81a-15d5-4479-a293-c4011c0311a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:59.446930 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dc81a-15d5-4479-a293-c4011c0311a3 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:59.549932 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1456/2919] 10.222.0.59 () {60 vars in 1143 bytes} [Thu May 12 21:22:59 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 21:22:59.554652 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79fff6-b15a-4436-bac6-342c1e0bfa18 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:59.565741 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79fff6-b15a-4436-bac6-342c1e0bfa18 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:59.570399 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d5ec5-ab15-46c8-be7a-fc10cb731ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:59.571065 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d5ec5-ab15-46c8-be7a-fc10cb731ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:59.571361 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d5ec5-ab15-46c8-be7a-fc10cb731ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:59.571642 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d5ec5-ab15-46c8-be7a-fc10cb731ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:59.572410 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d5ec5-ab15-46c8-be7a-fc10cb731ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:59.574053 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d5ec5-ab15-46c8-be7a-fc10cb731ed4 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:59.584898 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1464/2920] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:59.588874 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dc81a-15d5-4479-a293-c4011c0311a3 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:59.599348 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dc81a-15d5-4479-a293-c4011c0311a3 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:59.603832 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c9b72-d3a7-416c-9162-ac7965abd70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:59.604495 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c9b72-d3a7-416c-9162-ac7965abd70f admin admin] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:59.604780 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c9b72-d3a7-416c-9162-ac7965abd70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:59.605058 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c9b72-d3a7-416c-9162-ac7965abd70f admin admin] PATH_INFO: `/v3/roles` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:59.605827 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c9b72-d3a7-416c-9162-ac7965abd70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:59.607461 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c9b72-d3a7-416c-9162-ac7965abd70f admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:59.617108 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1457/2921] 10.222.0.59 () {58 vars in 1121 bytes} [Thu May 12 21:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 21:22:59.621199 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d5ec5-ab15-46c8-be7a-fc10cb731ed4 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:59.631095 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d5ec5-ab15-46c8-be7a-fc10cb731ed4 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:59.635682 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661cce2-d5d2-4e35-a0fc-88373db20d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:59.636560 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661cce2-d5d2-4e35-a0fc-88373db20d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:59.636877 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661cce2-d5d2-4e35-a0fc-88373db20d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:59.637158 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661cce2-d5d2-4e35-a0fc-88373db20d66 admin admin] PATH_INFO: `/v3/projects/79a85de2347c46b68f45ae47d41943d2/users/d3deb7328cb84df08a471215aaaaa32f/roles/4982f0e43bc8430d81d3906431eff62e` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:59.651914 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661cce2-d5d2-4e35-a0fc-88373db20d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a85de2347c46b68f45ae47d41943d2, user_id=d3deb7328cb84df08a471215aaaaa32f, role_id=4982f0e43bc8430d81d3906431eff62e)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:59.655833 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661cce2-d5d2-4e35-a0fc-88373db20d66 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:59.756840 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1465/2922] 10.222.0.59 () {60 vars in 1482 bytes} [Thu May 12 21:22:59 2022] PUT /identity/v3/projects/79a85de2347c46b68f45ae47d41943d2/users/d3deb7328cb84df08a471215aaaaa32f/roles/4982f0e43bc8430d81d3906431eff62e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:22:59.767893 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f48478-a921-4c6f-a0f3-4fab86bc49df None None] REQUEST_METHOD: `POST` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:59.768188 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f48478-a921-4c6f-a0f3-4fab86bc49df None None] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:59.768482 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f48478-a921-4c6f-a0f3-4fab86bc49df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:59.796470 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.auth.core [None req-00f48478-a921-4c6f-a0f3-4fab86bc49df None None] MFA Rules not processed for user `d3deb7328cb84df08a471215aaaaa32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:22:59.797732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-00f48478-a921-4c6f-a0f3-4fab86bc49df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:59.861782 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1458/2923] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:22:59.872195 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661cce2-d5d2-4e35-a0fc-88373db20d66 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:22:59.874064 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-6661cce2-d5d2-4e35-a0fc-88373db20d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:22:59.930078 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661cce2-d5d2-4e35-a0fc-88373db20d66 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:22:59.933685 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb049b2-1daf-4e4b-9f25-d77cb8af7101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32db19a943345b6ba1c91e79739835f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:22:59.934867 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb049b2-1daf-4e4b-9f25-d77cb8af7101 service cinder] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:22:59.935151 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb049b2-1daf-4e4b-9f25-d77cb8af7101 service cinder] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:22:59.935429 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb049b2-1daf-4e4b-9f25-d77cb8af7101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:22:59.944016 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb049b2-1daf-4e4b-9f25-d77cb8af7101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:22:59.945540 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb049b2-1daf-4e4b-9f25-d77cb8af7101 service cinder] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:22:59.955006 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1466/2924] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:22:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:23:20.558010 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f48478-a921-4c6f-a0f3-4fab86bc49df None None] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:23:20.619152 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f48478-a921-4c6f-a0f3-4fab86bc49df None None] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:23:20.623712 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:23:20.624581 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:23:20.624867 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:23:20.625144 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] PATH_INFO: `/v3/users/d3deb7328cb84df08a471215aaaaa32f` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:23:20.626366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3deb7328cb84df08a471215aaaaa32f)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:23:20.628268 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:23:20.820752 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3deb7328cb84df08a471215aaaaa32f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:23:20.832179 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3deb7328cb84df08a471215aaaaa32f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:23:20.833724 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3deb7328cb84df08a471215aaaaa32f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:23:20.898842 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3deb7328cb84df08a471215aaaaa32f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:23:20.906615 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3deb7328cb84df08a471215aaaaa32f'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:23:20.912647 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1459/2925] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:23:20 2022] DELETE /identity/v3/users/d3deb7328cb84df08a471215aaaaa32f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:23:20.917334 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655761d-0eb3-49d2-ba02-a589b215f44c None None] REQUEST_METHOD: `POST` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:23:20.917815 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655761d-0eb3-49d2-ba02-a589b215f44c None None] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:23:20.917992 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655761d-0eb3-49d2-ba02-a589b215f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:23:20.935809 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.auth.core [None req-9655761d-0eb3-49d2-ba02-a589b215f44c None None] MFA Rules not processed for user `4a85c2f6540a47cfa927556bdcddaf95`. Rule list: `[]` (Enabled: `True`). {{(pid=80203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 21:23:20.937021 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9655761d-0eb3-49d2-ba02-a589b215f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:23:20.994108 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1467/2926] 10.222.0.59 () {58 vars in 957 bytes} [Thu May 12 21:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 21:23:21.003669 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:23:21.005625 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:23:21.060992 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10cbac-eb5f-4136-9e38-f68ab9201d85 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:23:21.064948 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53414f6-0e06-4462-bf26-cdcf06b65228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:23:21.065632 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53414f6-0e06-4462-bf26-cdcf06b65228 service neutron] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:23:21.065922 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53414f6-0e06-4462-bf26-cdcf06b65228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:23:21.066199 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53414f6-0e06-4462-bf26-cdcf06b65228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:23:21.075973 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53414f6-0e06-4462-bf26-cdcf06b65228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:23:21.077366 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53414f6-0e06-4462-bf26-cdcf06b65228 service neutron] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:23:21.087453 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1460/2927] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:23:21.489342 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655761d-0eb3-49d2-ba02-a589b215f44c None None] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:23:21.490936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9655761d-0eb3-49d2-ba02-a589b215f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:23:21.505759 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655761d-0eb3-49d2-ba02-a589b215f44c None None] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:23:21.510899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:23:21.511773 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:23:21.512060 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:23:21.512336 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] PATH_INFO: `/v3/projects/79a85de2347c46b68f45ae47d41943d2` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:23:21.513576 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a85de2347c46b68f45ae47d41943d2)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:23:21.515479 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:23:21.669061 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a85de2347c46b68f45ae47d41943d2', 'request_id': 'req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:23:21.674352 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a85de2347c46b68f45ae47d41943d2', 'request_id': 'req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:23:21.761935 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a85de2347c46b68f45ae47d41943d2', 'request_id': 'req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:23:21.773843 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] The token cache is being invalidate because project 79a85de2347c46b68f45ae47d41943d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:23:21.774134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:23:21.774756 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:23:21.776451 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1468/2928] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:23:21 2022] DELETE /identity/v3/projects/79a85de2347c46b68f45ae47d41943d2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:24:06.111525 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53414f6-0e06-4462-bf26-cdcf06b65228 service neutron] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:24:06.112952 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-c53414f6-0e06-4462-bf26-cdcf06b65228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:24:06.190064 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53414f6-0e06-4462-bf26-cdcf06b65228 service neutron] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:24:06.254401 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4432a-9f5e-4648-ac52-3d63c95d57cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:24:06.255067 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4432a-9f5e-4648-ac52-3d63c95d57cf service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:24:06.255349 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4432a-9f5e-4648-ac52-3d63c95d57cf service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:24:06.255622 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4432a-9f5e-4648-ac52-3d63c95d57cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:24:06.257441 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-55f4432a-9f5e-4648-ac52-3d63c95d57cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:24:06.270560 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4432a-9f5e-4648-ac52-3d63c95d57cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:24:06.272122 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4432a-9f5e-4648-ac52-3d63c95d57cf service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:24:06.283503 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1461/2929] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:24:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:24:06.366179 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:24:06.367708 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:24:06.428381 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769308d4-0c82-4d63-b4d0-0d23ebf8bb51 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:24:06.431976 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac383b-1869-4876-93a2-cd25eeb51ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:24:06.432628 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac383b-1869-4876-93a2-cd25eeb51ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:24:06.432915 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac383b-1869-4876-93a2-cd25eeb51ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:24:06.433909 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac383b-1869-4876-93a2-cd25eeb51ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:24:06.435855 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-36ac383b-1869-4876-93a2-cd25eeb51ad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:24:06.449838 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac383b-1869-4876-93a2-cd25eeb51ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:24:06.451216 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac383b-1869-4876-93a2-cd25eeb51ad0 service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:24:06.462660 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1469/2930] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:24:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:24:08.196169 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4432a-9f5e-4648-ac52-3d63c95d57cf service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:24:08.197616 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-55f4432a-9f5e-4648-ac52-3d63c95d57cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:24:08.211800 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4432a-9f5e-4648-ac52-3d63c95d57cf service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:24:08.218476 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc215a9-9f6f-4727-80b1-fbfa227c2a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '156646eda779439784ddbc7d1fbd5b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:24:08.219126 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc215a9-9f6f-4727-80b1-fbfa227c2a38 service nova] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:24:08.219408 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc215a9-9f6f-4727-80b1-fbfa227c2a38 service nova] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:24:08.219685 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc215a9-9f6f-4727-80b1-fbfa227c2a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:24:08.221732 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6fc215a9-9f6f-4727-80b1-fbfa227c2a38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:24:08.234512 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc215a9-9f6f-4727-80b1-fbfa227c2a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:24:08.236256 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc215a9-9f6f-4727-80b1-fbfa227c2a38 service nova] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:24:08.247837 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1462/2931] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:24:20.471710 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac383b-1869-4876-93a2-cd25eeb51ad0 service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:24:20.480305 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac383b-1869-4876-93a2-cd25eeb51ad0 service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:24:20.485067 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee5147-ecd5-4ff0-8b37-0fda333d924d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4379d3e8b38645978efb08ea6f560fc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:24:20.485746 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee5147-ecd5-4ff0-8b37-0fda333d924d service neutron] REQUEST_METHOD: `GET` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:24:20.486039 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee5147-ecd5-4ff0-8b37-0fda333d924d service neutron] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:24:20.486313 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee5147-ecd5-4ff0-8b37-0fda333d924d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:24:20.488056 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-9fee5147-ecd5-4ff0-8b37-0fda333d924d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:24:20.551691 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee5147-ecd5-4ff0-8b37-0fda333d924d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:24:20.553128 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee5147-ecd5-4ff0-8b37-0fda333d924d service neutron] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:24:20.562738 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1470/2932] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 21:24:28.337082 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc215a9-9f6f-4727-80b1-fbfa227c2a38 service nova] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:24:28.338657 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-6fc215a9-9f6f-4727-80b1-fbfa227c2a38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:24:28.352766 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc215a9-9f6f-4727-80b1-fbfa227c2a38 service nova] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:24:28.357624 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:24:28.358500 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:24:28.358788 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:24:28.359070 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] PATH_INFO: `/v3/users/ce3a8645c67e438f8f4e6aa933daeb26` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:24:28.360269 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3a8645c67e438f8f4e6aa933daeb26)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:24:28.362232 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:24:28.535607 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3a8645c67e438f8f4e6aa933daeb26'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:28.546864 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3a8645c67e438f8f4e6aa933daeb26'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:28.547527 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3a8645c67e438f8f4e6aa933daeb26'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:28.609745 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3a8645c67e438f8f4e6aa933daeb26'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:28.618116 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3a8645c67e438f8f4e6aa933daeb26'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:28.624663 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1463/2933] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:24:28 2022] DELETE /identity/v3/users/ce3a8645c67e438f8f4e6aa933daeb26 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:24:28.892416 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee5147-ecd5-4ff0-8b37-0fda333d924d service neutron] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:24:28.905082 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee5147-ecd5-4ff0-8b37-0fda333d924d service neutron] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:24:28.963899 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:24:28.964766 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:24:28.965471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:24:28.965471 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] PATH_INFO: `/v3/projects/d32287a21bed4346ae982132d4f29764` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:24:28.967235 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32287a21bed4346ae982132d4f29764)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:24:28.969163 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:24:29.077923 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32287a21bed4346ae982132d4f29764', 'request_id': 'req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:29.083275 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32287a21bed4346ae982132d4f29764', 'request_id': 'req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:29.152326 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32287a21bed4346ae982132d4f29764', 'request_id': 'req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:29.164132 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] The token cache is being invalidate because project d32287a21bed4346ae982132d4f29764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:24:29.164529 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:29.165157 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:29.166719 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1471/2934] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:24:28 2022] DELETE /identity/v3/projects/d32287a21bed4346ae982132d4f29764 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:24:29.171249 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:24:29.172697 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:24:29.187668 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a388be9-b040-4952-bee2-603a024f85a7 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:24:29.245380 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:24:29.246293 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:24:29.246585 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:24:29.247473 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] PATH_INFO: `/v3/users/496be8ef31484b979cd5125f3e0c5c93` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:24:29.248722 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=496be8ef31484b979cd5125f3e0c5c93)` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:24:29.250689 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:24:29.443767 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496be8ef31484b979cd5125f3e0c5c93'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:29.456705 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496be8ef31484b979cd5125f3e0c5c93'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:29.457431 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496be8ef31484b979cd5125f3e0c5c93'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:29.530101 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496be8ef31484b979cd5125f3e0c5c93'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:29.537425 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.notifications [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496be8ef31484b979cd5125f3e0c5c93'} {{(pid=80202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:29.543302 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1464/2935] 10.222.0.59 () {58 vars in 1223 bytes} [Thu May 12 21:24:29 2022] DELETE /identity/v3/users/496be8ef31484b979cd5125f3e0c5c93 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:24:29.817514 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] Authenticating user token {{(pid=80203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:24:29.818936 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.fernet_utils [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:24:29.832332 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd7f26-73d1-4bc6-9cd4-e69530eee1e6 admin admin] Validating token access rules against request {{(pid=80203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:24:29.890964 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a85c2f6540a47cfa927556bdcddaf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023813922bcf4863880d01ff0f27548c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:24:29.891842 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:24:29.892134 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] SCRIPT_NAME: `/identity` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:24:29.892423 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] PATH_INFO: `/v3/projects/fc343c4856bf4b16963e9761c9b8e95f` {{(pid=80203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:24:29.893658 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc343c4856bf4b16963e9761c9b8e95f)` {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:24:29.895578 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] RBAC: Authorization granted {{(pid=80203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:24:30.034625 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc343c4856bf4b16963e9761c9b8e95f', 'request_id': 'req-78b986d7-8859-4eb5-b988-711426cb337b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:30.039787 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc343c4856bf4b16963e9761c9b8e95f', 'request_id': 'req-78b986d7-8859-4eb5-b988-711426cb337b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:30.107256 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc343c4856bf4b16963e9761c9b8e95f', 'request_id': 'req-78b986d7-8859-4eb5-b988-711426cb337b'} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:30.118703 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] The token cache is being invalidate because project fc343c4856bf4b16963e9761c9b8e95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 21:24:30.118994 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:30.123384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: DEBUG keystone.notifications [None req-78b986d7-8859-4eb5-b988-711426cb337b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 21:24:30.123384 dv-cinder-815659-7-iscsi devstack@keystone.service[80203]: [pid: 80203|app: 0|req: 1472/2936] 10.222.0.59 () {58 vars in 1232 bytes} [Thu May 12 21:24:29 2022] DELETE /identity/v3/projects/fc343c4856bf4b16963e9761c9b8e95f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 21:27:43.009811 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] Authenticating user token {{(pid=80202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 21:27:43.011221 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:27:43.135784 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f48e75-1f2d-4408-bd63-579612d17942 admin admin] Validating token access rules against request {{(pid=80202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 21:27:43.197095 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350e62d-95e3-4836-b6db-60fa003adefb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65431a33849249ed8686d03b0c2e3a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3888c07a45094a87bfacd9899fcf3dd7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 21:27:43.197797 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350e62d-95e3-4836-b6db-60fa003adefb service placement] REQUEST_METHOD: `GET` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 21:27:43.198088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350e62d-95e3-4836-b6db-60fa003adefb service placement] SCRIPT_NAME: `/identity` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 21:27:43.198372 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350e62d-95e3-4836-b6db-60fa003adefb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 21:27:43.200203 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.fernet_utils [None req-1350e62d-95e3-4836-b6db-60fa003adefb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 21:27:43.212088 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350e62d-95e3-4836-b6db-60fa003adefb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 21:27:43.213773 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350e62d-95e3-4836-b6db-60fa003adefb service placement] RBAC: Authorization granted {{(pid=80202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 21:27:43.224789 dv-cinder-815659-7-iscsi devstack@keystone.service[80202]: [pid: 80202|app: 0|req: 1465/2937] 10.222.0.59 () {60 vars in 1365 bytes} [Thu May 12 21:27:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)